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LIST OF ACRONYMS 





Blue-Advantage Plus of Kansas City 
Behavioral Health Management Organization 
Consumer Assessment of Health Plans Survey 
Centers for Disease Control and Prevention 


A statistical test that is used to examine the probability of a 
change ordifference in ratesisdue to chance. 


Confidence Interval 
Children’s Mercy Family Health Partners 
Community Mental Health Center 


Centers for Medicare and Medicaid Services, U.S. Department 
of Health and Human Services 


Curent Procedural Terminology 
Calendar Year 


Department of Insurance, Financial Institutions and Professional 
Registration 


U.S. Department of Health and Human Services 
Missoun Department of Health and Senior Services 
Missourn Department of Social Services 

Early, Periodic Screening, Diagnosisand Treatment 
Extemal Quality Review 

Extemal Quality Review Organization 

MO HealthNet Fee-forService 

Harmony Health Plan 

HealthCare USA 


MO HealthNet Healthy Children and Youth, the Missouri 
Medicaid EPSDT program 
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MBE 


MC + 


MC+MCOs 


MC HP 
MCO 


MCP 

MDIFP 

MMIS 

MO HEALTHNET 


MO HealthNet 
MC HPs 


MOHSAIC 


NCPDP 


NCQA 


Pectormaace Management 
Solutions Group euc 


Healthcare Effectiveness Data and Information Set 
Health Insurance Portability and Accountability Act 
Health Information Systems 

Health Maintenance Organization 


Intemational Classification of Diseases, Ninth Revision, Clinical 
Modification, Wond Health Organization 


Intemal Control Number 

Information Systems Capability Assessment 
Local Public Health Agency 
Minority-owned Business Enterprise 


The name of the Missoun Medicaid Program for families, 
children, and pregnant women, prorto J uly 2007. 


Missouri Medicaid Program Managed Care Organizations (prior 
to J uly 2007) 


Managed Care Health Plan 
Managed Care Organization 
Mercy CarePlus 


Missoun Department of Insurance, Financial Institutions and 
Professional Registration 


Medicaid Management Information System 


The name of the Missoun Medicaid Program for families, 
children, and pregnant women. 


Missouri Medicaid Program Managed Care Health Plans 


Missoun Public Health Integrated Information System 


National Council for Prescription Drug Program 


National Committee for Quality Assurance 
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N.S. 


NSF/CMS 1500 


QA &l 


QI/UM 
Coordinator 


SMA 


SPHA 


UB-92 


Not significant, indicating that a statistical test does not result in 
the ability to conclude that a real effect exists. 


National Standard Format/ Centerfor Medicare and Medicaid 
Services Form 1500 


Primary Care Provider 

Prepaid Inpatient Health Plan 
Performance Improvement Project 
Peer Review Organization 


MO HealthNet Managed Care Quality Assessment and 
Improvement Advisory Group 


Quality Improvement/ Utilization Management Coordinator 


State Medicaid Agency, the Missour Department of Social 
Services, MO HealthNet Division 


State Public Health Agency, the Missoun Department of Health 
and Senior Services 


Universal Billing Form 92 
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GLOSSARY AND OPERATIONAL DEFINITIONS 


Administrative Method 


Accuracy (Match) 
Rate 


Accuracy ofa data 
field 


Accuracy of the Slate 
encounter claims 
database 
Commission (or 
surplus enc ounter 


claim) 


The Administrative Method of calculating HEDIS 
Performance Measures requires the MCHP to identify the 
denominatorand numerator using transaction data or other 
administrative databases. The Administrative Method 
outlines the collection and calculation of a measure using 
only administrative data, including a description of the 
denominator (i.e., the entire eligible population), the 
numerator requirements (i.e., the indicated treatment or 


procedure) and any exclusion(s) allowed forthe measure. 


The ratio of identical or correct information in the medical 
record and the SMA relative to the number of encounters 
that took place. 


The extent to which an encounter claim field contains the 
corect type of information (e.g., numeric, alpha, alpha 
numeric) in the proper format (e.g., mm/dd/yyyy for date 
field). 


The extent to which encounters are being submitted for 100 


percent of the servicesthat are provided. ! 


An encounter that is represented in the SMA encounter 
claims database but not the medical record; ora duplicate 


encounter. 


1 Medstat (1999). A Guide for States to Assist in the Collection and Analysis of Medicaid Managed Care Data: 
Second Edition 
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Completeness of a The extent to which an encounter claim field contains data 
data field (either present or absent). 


Confidence intervalor The range of accuracy of a population estimate obtained 
level from a sample. 


Encounter data “Encounter data are records of health care services that 


have been provided to patients.” 2 


Error An erorin coding or recording an encounter claim. 


Fault (Error) Rate The ratio of missing and eroneous records relative to the 
total number of encounters that took place? The rate at 
which the SMA encounterclaimsdata doesnot match the 
medical record orthe MCHP paid encounterclaimsdata 


(the converse of match rate). 


Hybrid Method Hybrid Method requires the MCHP to identify the numerator 
through both administrative and medical record data. The 
MCHP reportsa rate based on membersin the sample who 
are found through either administrative or medical record 


data to have received the service identified in the 


numerator. 
Intenater reliability A method of addressing the intemal validity of a study by 
(IRR) ensuring that data are collected in a consistent manner 


across data collectors. 


? Medstat (1999).: A Guide for States to Assist in the Collection and Analysis of Medicaid Managed Care Data. 
Medstat: Santa Barbara. Second Edition 

3 Centers for Medicare and Medicaid Services (2002). Validating Encounter Data: A protocol for use in 
conducting Medicaid External Quality Review activities, Final Protocol, Version 1.0, U.S. Department of Health 
and Human Services. 
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Omission (or missing 


encounter claim) 


Paid claim 


Probability sample 


Random sample 


Reasonableness ofa 
data field 


Reliability 
Sampling frame 


Sampling unit 


Simple sample 


An encounter that occured but isnot represented in the 


State encounter claims database. 


An encounter claim that has been paid by the MCHP. 


A sample in which every element in the sampling frame has 
a known, non-zero probability of being included ina 
sample. This produces unbiased estimates of population 
parameters that are linear functions of the observations 


from the sample data‘. 


Selection of sampling units from a sampling frame where 


each unit hasan equal probability of selection. 


The extent to which an encounter claim field represents a 
valid value (e.g., an actual procedure code, actual birth 


date); also referred to as validity of the data. 


The consistency of findings acrosstime, situations, or raters. 


The population of potential sampling units that meet the 
criteria forselection (e.g., Medical encounter claim types 
from J anuary 1, 2004 through March 31, 2004). 


Each unit in the sampling frame (e.g., an encounter). 


Selection of sampling units from one sampling frame. 





* Levy, P.S., Lemeshow, S. (1999). Sampling of Populations: Methods and Applications, Third Edition. John 


Wiley and Sons: New York. 
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Unpaid claim 


All unpaid and denied claims from the MCHP; All claims not 
paid by the MCHP either through capitation or through 


other payment methodology. 
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Figure 19 - Home Health Encounter Claim Types per 1,000 Members, , J uly 1, 2006 - 
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Figure 20 - Home Health Encounter Claim Types per 1,000 Members, J uly 1, 2007 - 
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Figure 21 - Inpatient Encounter Claim Types per 1,000 Members, J uly 1, 2006 - 
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Figure 22 - Inpatient Encounter Claim Types per 1,000 Members, J uly 1, 2007- 
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Figure 23 - Outpatient Hospital Encounter Claim Types per 1,000 Members, J uly 1, 
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Figure 24 - Outpatient Hospital Encounter Claim Types per 1,000 Members, J uly 1, 
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Figure 25 - Pharmacy Encounter Claim Types per 1,000 Members, J uly 1, 2006 - 
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Figure 26 - Pharmacy Encounter Claim Types per 1,000 Members, J uly 1, 2007 - 
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Figure 27 - Percentage Proportion of Claim Types perMC+MCO, J uly 1, 2006 - 
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Figure 28 - Percentage Proportion of Claim Types per MO HealthNet Managed Care 
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Figure 29 - Encounter Data Procedure Validation Rate, J uly 1, 2007 - September 30, 
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Figure 30 - Encounter Data Diagnosis Validation Rate- J uly 1, 2007- September 30, 
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1.1 Intoduction 


The United States Department of Health and Human Services (DHHS), Centers for 
Medicare and Medicaid Services (CMS) requires an annual, independent extemal 
evaluation of State Medicaid Managed Care programs by an Extemal Quality 
Review Organization (EQRO). Extemal Quality Review is the analysis and evaluation 
by an approved EQRO of aggregate information on quality, timeliness, and access 
to health care services fumished by MO HealthNet Managed Care health plans 
(MCHPs) and their contractorsto recipients of MO HealthNet Managed Care 
services. The Centers for Medicare and Medicaid Services (42 CFR § 433 and § 438; 
Medicaid Program, Extemal Quality Review of Medicaid Managed Care 
Organizations) rule specifies the requirements for evaluation of Medicaid managed 
Care programs. The present report summanczes the findings of the third year of 
implementation of the mandatory activities for Extemal Quality Review of the MO 
HealthNet Managed Care Program in Missour' as conducted by Behavioral Health 
Concepts, Inc., a PRO-Like Entity certified by CMSto conduct Extemal Quality 


Review (EQR) in all U.S. states and temitories. 


The State of Missouri contracts with the following MO HealthNet Managed Care 
health plans represented in this report: 

e Mercy CarePlus (MCP) 

e HealthCare USA (HCUSA) 

e Harmony Health Plan of Missoun (Harmony) 

e Missour Care (MOCare) 

e Children’s Mercy Family Health Partners (C MFHP) 

e Blue-Advantage Plus of Kansas City (BA+) 


The EQR technical report analyzesand aggregates data from three mandatory EQR 


activities and one optional activity asdescribed below: 
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1) Validating Performance Improvement Projects> 

Each MO HealthNet Managed Care health plan (MCHP) conducted performance 
improvement projects (PIPs) during the 12 months preceding the audit; two of these 
PIPs were validated through a combination of self-selection and EQRO review. The 
final selection of PIPsto be audited wasdetermmined by the State Medicaid Agency 
(SMA; Missourn Department of Social Services, MO HealthNet Division (MHD). 


2) Validating Performance Measures® 
The three performance measures validated were HEDIS 2007 measures of 
Adolescent Well Care Visits, Annual Dental Visit, and Follow-Up After Hospitalization 


for Mental Illness. 


3) Validating Encounter Data’ (optional activity) 

Validation of Encounter Data examined the completeness, accuracy, and reliability 
of specific fields in the SMA database; and the extent to which paid claimsin the 
SMA were represented in the medical recordsof MC+Managed Care Members; 


and 


4) MO HealthNet Managed Care health plan Compliance with Managed Care 
Regulations. ® 


The EQRO conducted all protocol activities, with the exception of the MCHP 
Compliance with Managed Care Regulations Protocol. The SMA conducted these 


activities and requested the EQRO to review them (Compliance Review Analysis). 





> Department of Health and Human Services. Centers for Medicare and Medicaid Services (2002). Validating 
Performance Improvement Projects: A protocol for use in Conducting Medicaid External Quality Review 
Activities, Final Protocol, Version 1.0, May 1, 2002. Washington, D.C.: Author. 

® Department of Health and Human Services. Centers for Medicare and Medicaid Services (2002). Validating 
Performance Measures: A protocol for use in Conducting Medicaid External Quality Review Activities, Final 
Protocol, Version 1.0, May 1, 2002. Washington, D.C.: Author. 

7 Department of Health and Human Services. Centers for Medicare and Medicaid Services (2002). Validating 
Encounter Data: A protocol for use in Conducting Medicaid External Quality Review Activities, Final Protocol, 
Version 1.0, May 1, 2002. Washington, D.C.: Author. 

8 Department of Health and Human Services. Centers for Medicare and Medicaid Services (2003). Monitoring 
Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health Plans (PIHPs): A protocol for 
determining compliance with Medicaid Managed Care Proposed Regulations at 42 CFR §400, 430, et al., Final 
Protocol, Version 1.0, February 11, 2003. Washington, D.C.: Author. 


lutions Group 
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1.2 Preparation for the 2007 Extemal Quality Review 


PREPARATION WITH THE STATE MEDICAID AGENCY 

Effective J uly 1, 2006 the State of Missouri contract forthe Extemal Quality Review of 
the MO HealthNet Managed Care Program (State of Missour Contract No: 

C 306122001, Amendment No.: 003) was revised to comply with federal requirements 
for states to contract with an extemal, independent entity to implement the 
mandatory protocols for Extemal Quality Review. The first monthly meeting for 
planning the scope of work, technical methods and objectives, and analyses was 
held by the SMA in October 2007. Meetings were held with the SMA and the EQRO 
in December 2007, J anuary 2008, March 2008, April 2008, J une 20, 2008 and August 
2008. Additional meetings and teleconference calls were conducted asneeded 
between SMA and EQRO personnel. 


At the first meeting in October 2007, the previous years’ report was discussed and 
the plan forthe 2007 audit was discussed. During the month of October, the EQRO 
clanfied the SMA’s objectives for each of the protocols, developed data requests, 
prepared detailed proposals forthe implementation and analysis of data foreach 
protocol, and prepared materials for SMA review. Written proposals foreach 
protocol were submitted in November 2007 by the EQRO for review, discussion, 
revision, and approval. By December 2007, the EQRO had negotiated with the SMA 


the data request for State encounter data to be validated. 


PREPARATION OF MO HEALTHNET MANAGED CARE HEALTH PLANS 

During October 2007, preparation of MO HealthNet Managed Care health plans for 
the implementation of the 2007 EQR wasconducted by the EQRO Project Director 
and personnel. To begin, the EQRO Project Director presented a timeline for project 
implementation and answered MCHP questions at the October 2007 MO HealthNet 
Managed Care QA&I Advisory Group meeting and MO HealthNet Managed Care 
All-Plan Meetings. The EQRO Project Director and personnel then conducted 
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Orientation to the protocolsand the EQR processes with each MO HealthNet 


Managed Care health plans. 


The EQRO Assistant Project Director ananged the datesof the teleconference calls 
with health plan QI/UM Coordinators or Plan Administrators. A detailed 
presentation, tentative list of data requests, and the proposalsapproved by the 
SMA were sent to health plans priorto the teleconference orientation sessions. MO 
HealthNet Managed Care health plans were requested to have all personnel 
involved in fulfilling the requests orin implementing activities related to the protocols 
(e.g., performance improvement projectsto be validated, performance measures 
to be validated, encounterdata requested) present at the teleconference calls. 
[The orientation presentation is contained in Appendix 1.] An SMA representative 
attended all conference callsand received minutes of the meetings taken by the 
EQRO upon completion of all the calls) Conference calls with EQRO and health 
plan personnel occured between December 4, 2007 and December 10, 2007. To 
avoid confusion and the inundation of multiple requests at once, the requests for 
information from MO HealthNet Managed Care health plans were implemented in 
a staged approach from J anuary 2007 through April 2008. All communications 
(letters, generaland specific instructions) were submitted for review, revision, and 


approval by the SMA priorto sending them to the health plans. 


DEVELOPMENT OF WORKSHEETS, TOOLS, AND RATING CRITERIA 

The EQRO Project Director, Research Associate, Assistant Project Director, and a 
healthcare provider were responsible for modifying the worksheets and tools used 
by the EQRO during the 2006 audit. The EQRO Assistant Project Director revised the 
worksheet (Attachment B) of the Validating Performance Improvement Project 
Protocol to add detail for several items that were specific to the MO HealthNet 


Managed Care Program. 


Forthe Validating Encounter Data Protocol, the EQRO Project Director revised both 


the data analytic plan in collaboration with the SMA aswell as methodsand 
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procedures based on the content, quality and format of data provided by the SMA 
and health plans. The SMA selected the fields to validate for completeness, 
accuracy, and reliability of paid claims submitted by MO HealthNet Managed Care 
health plans. The EQRO developed definitions of all field parameters for review, 
revision, and approval by the SMA. Encounter data critical field parameters were 
approved by the SMA at the December 2007 meeting between the SMA and the 
EQRO. 


The Validating Performance Measures Protocol worksheets were revised and 
updated by the EQRO Project Directorand Research Associate to reflect the 
Performance Measures selected for review for HEDIS 2007. The worksheets had been 
developed by Behavioral Health Concepts, Inc. staff during the previous year's 
audit. 


The SMA continued to conduct the activities of the MO HealthNet Managed Care 
Compliance with Managed Care Regulations Protocol through the state contract 
compliance monitoring processand the work of the EQRO involved the review and 
evaluation of this information (see Medicaid Program; Extemal Quality Review of 
Medicaid Managed Care Organizations of 2003, CFR § 438.58). The state contract 
for EQRO requires the review of SMA’s activities with regard to the Protocol, 
however, additional policiesand documents were requested priorto and during the 
on-site visits with health plans when information was incomplete orunclear. To 
facilitate the review of compliance with federal regulations, the EQRO Assistant 
Project Director revised a previously developed cross-walk between the SMA 
contract requirements for Medicaid managed care and the federal Medicaid 


Managed Care Regulations. 


The MO HealthNet Managed Care Program consultant, who has participated in the 
EQRO forthe past sx years, reviewed and refined the tool. Feedbackon 
inconsistencies between the MO HealthNet Managed Care contract and federal 
requirements was provided immediately to the SMA. The EQRO utilized the rating 
system developed during the 2004 audit to provide ratings foreach health plans 
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compliance. The SMA provided state compliance review information to the EQRO 
forall health plans from February 2008 through J une 2008. The EQRO staff and the 
consultant reviewed all available materials and met with SMA staff to clarify SMA 
comments and compliance ratings; and identify issues for follow-up at site visits. 
Updateson MO HealthNet Managed Care health plan compliance were provided 
through eanly J uly 2008 to ensure that the EQRO had up-to-date information pror to 
the beginning of the on-site reviews. Recommended ratings were provided to SMA 


which were approved for utilization in this report. 


The following sections summanze the aggregate findingsand conclusions foreach 
of the mandatory protocols. The full report isorganized according to each protocol 
and contains detailed descriptions of the technical methods, objectives, findings, 
and conclusions (strengths, areas forimprovement, and recommendations). In 
addition, it provides health plan to health plan comparisons and individual MO 


HealthNet Managed Care health plan summanes for each protocol. 
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1.3 Validation of Performance Improvement Projects 


Forthe Validating Performance Improvement Projects (PIP) Protocol, the EQRO 
validated two PIPsforeach MO HealthNet Managed Care health plan that were 
underway during 2007. A total of 12 PiPs were validated. Eligible PIPs for validation 
were identified by the health plans, SMA, and the EQRO. The final selection of the 
PIPs forthe 2007 validation process was made by the SMA in December 2007. PIPs 
are to be aimed at studying the effectiveness of clinical ornon-clinic al interventions, 
and should improve processes highly associated with healthcare outcomes, and/or 
healthcare outcomesthemselves. They are to be camied out over multiple re- 
measurement periods to measure: 1) improvement; 2) the need for continued 
improvement; or 3) stability in improvement asa result of an intervention. Under the 
State contract forMO HealthNet Managed Care, health plans are required to have 
two active PIPs, one of which isclinical in nature and one non-clinical. Specific 
feedback and technical assistance wasprovided to each health plan by the EQRO 


during the site visits for improving study methods, data collection, and analysis. 


ACCESS TO CARE 

Accessto care wasan important theme addressed throughout all the PIP 
submissions reviewed. Five of the PIPs utilized enhanced case management 
proceduresto ensure that membershad accessto care, were reminded of 
appointments, and that case managers were available to ensure that bamiers to 
services were decreased. Two health plans focused on education and support to 
obtain appropriate servicesand medications forthe treatment of asthma and 
accessto lead screening (Missoun Care and Harmony Health Plan). All the projects 
reviewed used the format of the PIP to improve accessto care formembers. Three 
of the projects cleany focused on ensuring the members had adequate and timely 
access to services after being hospitalized for mental health related issues 
(HealthCare USA, Missouri Care, BA+). The on-site disc ussions with health plan staff 


indicate the realization that improving accessto care isan ongoing aspect of all 
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projectsthat are developed. One health plan (Mercy CarePlus), developed an 
ongoing PIP into a project that providescase management services to all pregnant 
members. Asoutcome data are finalized, and asan example of both improved 
accessand quality of care, this project should become a best practice to be 
shared throughout the health plans. 
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QUALITY OF CARE 

Topic identification was an area that provided evidence of the attention placed on 
providing quality servicesto members. Intervention development for PIPs also 
focused on the issue of quality services. All PIPSreviewed focused on topics that 
needed improvement, either in the intemal processes used to operate the health 
plan, orin the direct provision of servicesdelivered. The comesponding interventions 
that address bamiers to quality care and health outcomes were cleanly evident in 
the narratives submitted. There was further evidence of a commitment to quality of 
care during on-site discussion at each health plan, including the desire to supply 
supplemental and updated information to ensure that project effortsand outcomes 
were clearly reported. These interventions addressed key aspects of enrollee care 
and services, such as medication and treatment management; risk identification 
and stratification for various levels of care; monitoring provider accessand quality 
services; and preventive care. These efforts exemplified an attention to quality 


healthcare services. 


TIMELINESS OF CARE 

Timeliness of care wasthe major focusof a numberof the PiPsreviewed. Three 
projectsidentified the need fortimely aftercare for members who required inpatient 
hospitalization for mental illness (HealthC are USA, Missoun Care, and BA+). The 
remaining projects focused on subjects such as timely processing and resolution of 
grievancesand appeals (HealthCare US, and BA+), appropriate medicationsand 
treatment for asthma (Missoun Care), improved access to non emergent 
transportation services (Children’s Mercy Family Health Partners), improved access 
to well-child visits in the first 15 months of life (Children’s Mercy Family Health 
Partners). Alladdressed the need fortimely accessto preventive and primary 
health care services. The health plansall related their awareness of the need to 
provide not only quality, but timely services to members. Projects reflected this 
awareness in that they addressed intemal processes and direct service 


improvement. 
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RECOMMENDATIONS 
1. Itisrecommended that health planscontinue to refine their skills in the 


development and implementation of the Performance Improvement 
Projects. Improved training, assistance and expertise forthe design, statistic al 
analysis, and interpretation of PIP findings are available. One health plan 
(Children’s Mercy Family Health Partners) continues to utilize the servicesofa 
statistician from a local university to ensure valid and reliable findings. 

In the design of PIPs, the health plans need to use generally accepted 
practices for program evaluation to conduct PIPs. In addition to training on 
the development of PIPsand on-site technical assistance, referencesto the 
CMS protocol, “Conducting Performance Improvement Projects” were 
recommended by the EQRO at each health plan asa guideline to frame the 
development, reporting and analysis of the PIP. 

PIPs should be conducted on an ongoing basis, with at least quarterly 
measurement of some indicesto provide data about the need forchanges 
in implementation, data collection, or interventions. 

PIPs that are not yet complete should include narative reflecting next steps 
and a plan for how the PIP will be maintained and enhanced for future years. 
It appears that in most instances the health plans conduct PIPson an 
ongoing basis as part of their quality improvement program. Continuing to 
utilize these PIPs as toolsto improve the organizations ability to serve 


members is beneficial. 
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1.4 Validation of Perfomance Measures 


The Validating Performance Measures Protocol requires the validation or calculation 
of three performance measuresat each MO HealthNet Managed Care health plan 
by the EQRO. The measuresselected forvalidation by the SMA are required to be 
submitted by each health plan on an annual basis. The measures were also 
submitted by the State Public Health Agency (SPHA; Missoun Department of Health 
and Senior Services; DHSS) forall Managed Care Organizations (MCOs) operating in 
the State of Missoun. They were: 1) HEDIS 2007 Follow-Up After Hospitalization for 
Mental Illness; 2) HEDIS 2007 Adolescent Well-C are Visit; and 3) HEDIS 2007 Annual 
Dental Visit. Detailed specifications forthe calculation of these measures were 
developed by the National Committee for Quality Assurance (NCQA), a national 
accrediting organization for managed care organizations. The EQRO examined the 
information systems, detailed algorithms, health plan extract files, medical records, 
and data submissions provided to the SPHA to conduct the validation activities of 
this protocol. The data reported to the SPHA was based on MO HealthNet 
Managed Care health plan performance during 2006. 

QUALITY OF CARE 

The HEDIS 2007 Follow-Up After Hospitalization for Mental Illness measure is 
categorized asan Effectiveness of Care measure and isdesigned to measure the 


effec tiveness/ quality of care received by health plan members. 


One MO HealthNet Managed Care health plan was Fully Compliant with the 
specifications for calculation of this measure. The four remaining MO HealthNet 
Managed Care health plans were substantially complaint with the specifications for 
calculation of this measure. (Harmony isnot included in this evaluation as they were 


not a Missoun provider during the HEDIS 2007 measurement period.) 


Forthe 7-day follow up rate, three MO HealthNet Managed Care health plans (BA+, 
CMFHP and MO Care) reported rates (58.67%, 48.50% and 42.58%, respectively) that 


were higher than the National Medicaid Average (39.1%) for this measure and one 
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health plan (BA+ reported a rate higherthan the National Commercial Average 
(56.7%). 


The 7-Day reported rate forall MO HealthNet Managed Care health plans in 2007 
(35.52%) wasa 4.36% increase overthe 7-day rate reported in 2006 (the last year this 
measure was audited by the EQR). 

Forthe 30-day follow up rate, three MO HealthNet Managed Care health plans 
(BA+, CMFHP and MO Care) reported rates (76.00%, 88.37% and 63.16%, 
respectively) that were higher than the National Medicaid Average (57.7%) for this 
measure and two health plans (BA+and CMFHP) reported rates higher than the 


National Commercial Average (75.0%). 


The 30-Day reported rate forall MO HealthNet Managed Care health plans in 2007 
(60.06%) wasa 7.14% increase over the 30-day rate reported in 2006 (the last year 
this measure was audited by the EQR). 


Due to the high rates reported for this measure it can be concluded that MO 
HealthNet Managed Care health plan membersare receiving a higher quality of 
Care in the area of Follow-Up After Hospitalization for Mental Illness than other 


Medicaid recipients across the country. 


ACCESS TO CARE 
The HEDIS 2007 Annual Dental Visit measure is categorized asan Access/Availa bility 


of Service measure and isdesignated to measure the accessto care received. 


Forthe Annual Dental Visit measure, all five MC HealthNet Managed Care health 


plans reviewed were substantially compliant with the calculation of this measure. 


The rate for AllMO HealthNet Managed Care health plans of Annual Dental visits 
improved by 2.74% from the 2005 rate (the last year this measure was validated by 
the EQRO) of 29.76% to the 2007 rate of 32.50%. Thereby showing an increased level 


of dental care received in Missouri during the HEDIS 2007 measurement year. 


Cé=— Performance Management Solutions Group 41 
ee A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 1 
Report of Findings - 2007 Executive Summary 


For the Annual Dental Visit measure, none of the health plans reported a rate higher 
than the National Medicaid Average (42.5%). 


TIMELINESS OF CARE 

The HEDIS 2007 Adolescent Well Care Visits is categonzed asa Use of Services 
measure and isdesgnated to measure the timeliness of the care received. To 
increase the rate for both of these measures, age specific services must be 


delivered to membersona yeany basis. 


For the Adolescent Well Care Visits measure, one health plan was fully compliant 
with the specifications for calculation of this measure and the remaining four were 


substantially compliant with the measure’s calculation. 


Forthe Adolescent Well Care Visits measure, two health plans (CMFHP and MO 
Care) reported rates (42.82%and 44.91%, respectively) higher than the National 
Commercial Average (40.3%) and one health plan (MO Care) reported a rate 
higher than the National Medicaid Rate (43.6%), as well. 


The rate for All MO HealthNet Managed Care health plans improved by 4.68% from 
the 2004 reported rate of 30.13% for all health plans (the last year this measure was 
validated by the EQRO) to the 2007 rate forall health plans of 34.81% Thereby 
showing an increased level of well care visits delivered to adolescents in Missouri 


during the HEDIS 2007 measurement year. 


RECOMMENDATIONS 
1. The SMA should consider requiring the Hybrid Method of calculation forsome 
HEDIS measures. The two health plans who calculated the Adolescent Well 
Care Visits measure hybridly (CMFHP and MO Care) had the highest 
validated rates (42.82 %and 44.91%, respectively) and ratesabove both 
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National benchmarks (National Commercial rate 40.3% and National 
Medicaid rate 43.6%). 

2. The SMA should encourage technical assistance regarding the calculation of 
HEDIS performance measuresand medical record review processes for the 
calculation of performance measures. 

3. MO HealthNet Managed Care health plans with significantly lower rates of 
eligible membersand administrative hits should closely examine the potential 
reasons for fewer members or services identified. This may be due to member 
characteristics, but is more likely due to administration procedures and 
system characteristics such asthe proportion of members receiving services 
from capitated providers. Identifying methods of improving administrative 
hits will improve the accuracy in calculating the measures. 

4. The SMA should continue to have the EQRO validate the calculation of at 
least one measure from yearto year, forcomparison and analysis of trend 
data. 

5. MO HealthNet Managed Care health plans should run query reports early 
enough in the HEDIS season so that they may effectuate change in rates 


where interventions could easily be implored. 


1.5 Encounter Data Validation 


Encounterclaims data are used by SMAsto conduct rate setting and quality 
improvement evaluation. Before SMA encounter claims data can be used, it is 
necessary to establish the extent to which the data for critical fields (e.g., diagnosis 
and procedure codes, unitsand dates of service, member and provider identifiers) 
are complete (each field contains information), accurate (the information 
contained in each field isof the nght size and type), and valid (the information 
represents actual datesor procedure and diagnosis codes). Several critical fields 
foreach of six claim types (Medical, Dental, Home Health, Inpatient, Outpatient 
Hospital, and Pharmacy) were identified by the SMA and examined by the EQRO for 
completeness, accuracy, and validity using an extract file from SMA paid encounter 


claims. To examine the extent to which the SMA encounterclaimsdatabase was 
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complete (the extent to which SMA encounter claims database represents all claims 
paid by MO HealthNet Managed Care health plans); the level and consistency of 
services was evaluated by examining the rate of each of sixclaim types. 
Additionally, the representativeness (or completeness) of the SMA encounter claims 
database wasexamined by comparing data in the SMA encounter claims 
database to the medical recordsof members. A random sample of medical 
records wasused to compare the diagnosis codes, procedure codes, drug name 
dispensed, and drug quantity dispensed in the SMA encounter claims database with 
documentation in MC +member medical records. The findings of these comparisons 
were used to determine the completeness of the SMA encounter claims database 
in regardsto the medical records of members. The completeness of the SMA paid 
encounter claims wasthen compared with MO HealthNet Managed Care health 
plan records of paid and unpaid claims. This proved to be a difficult task, asall of 
the health plan data submissions did not include unique claim identifiers that could 
be used to accomplish this comparison, this isnot a health plan issue, these unique 
Claim identifiers are not available until a claim isof paid status. All six MO HealthNet 
Managed Care health plans provided data in the format necessary to make the 
comparisons. This was the first year that all health plans have done this correctly. The 
results obtained are detailed in the results of the Aggregate Encounter Data 


Validation section of this report. 
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STRENGTHS 

1. AllDentaland Pharmacy claim type fields examined were 100.00% complete, 
accurate and valid forall MO HealthNet Managed Care health plans. The 
SMA encounterclaims data critical fields examined foraccepted and paid 
claims of this type are valid for analysis. 

2. ForallMO HealthNet Managed Care health plans, the first Outpatient 
Diagnosis Code field was 100.0% complete, accurate and valid. 

3. All MO HealthNet Managed Care health plans submitted data in the format 
requested, and the EQRO wasable to perfomm the analysis of paid and 
unpaid claims contained in the SMA database. 

4. The examination of the level, volume, and consistency of services found 
significant variability between MO HealthNet Managed Care health plans in 
the rate of each type of claim (Medical, Dental, Inpatient, Outpatient 
Hospital, Home Health, and Pharmacy), with no pattemsof variation noted 
by Region ortype of MO HealthNet Managed Care health plan. 

5. There were no unmatched “paid” encounters within all claim types 
(Inpatient, Outpatient, and Pharmacy) forall Managed Care health plans. 


6. Unpaid claims represent less than .01% of all claims submitted to the SMA. 


AREAS FOR IMPROVEMENT 

1. ForallMO HealthNet Managed Care health plans, all unmatched encounters 
were due to missing ICN numbers, which are required to match the 
encounter to that of the SMA. 

2. The Procedure Code field in the Outpatient Home Health and Outpatient 
Hospital claim typesincluded some invalid information. Most of thiswasdue 
to blank fields or fields containing “00000”. 

3. The Inpatient first diagnosis claim field contained incomplete, invalid, and 
inaccurate fields. 

4. The match rates between the SMA database and MO HealthNet Managed 
Care health plan medical records forclaim type procedures were 52.0%, a 


significant decrease from last year’s match rate of 73.24% Medical records 
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that did not have procedure codes that matched the SMA encounterclaims 
extract file were in enor primarily due to missing orincorect information. 

The match rates between the SMA database and MO HealthNet Managed 
Care health plan medical records for claim type diagnoses were 47.0%; this is 
significantly lowerthan last year’s match rate of 70.56%. Medical records that 
did not have procedure codes that matched the SMA encounter claims 


extract file were in error primarily due to missing orincorrect information. 


RECOMMENDATIONS 


1. 


It isrecommended that the SMA institute additional edits for the Medical, 
Inpatient and Outpatient Hospital claim types to edit claims with blank fields 
ordummy values (e.g., “O00” and “99999999”), 

The SMA should continue to provide timely feedback to MO HealthNet 
Managed Care health plans regarding the rate of acceptance of each 
claim type and the types of enors associated with rejected claims. 
Additional analysis on the rate of consistency of services should examine 
demographic (e.g., age and gender distribution), epidemiological 
(diagnostic variables), and service delivery (e.g., number of users per month, 
rate of procedures orclaim types, units of service rates) characteristics to 
explain vanation across health plans or Regions. 

MO HealthNet Managed Care health plans’ medical record reviews should 
be targeted toward validation of diagnos and procedure codes and/or 
descriptors. 

The SMA should clarify the expectations forMO HealthNet Managed Care 
health plansin the level of completeness, accuracy, and validity and which 
data fieldsare required (e.g., Diagnosis Code fields 2 through 5). 

The SMA should provide timely feedback to MO HealthNet Managed Care 
health plans when standardsare not met and develop comective action 
plans when standards are not met within a reasonable amount of time as 
established by the SMA. 
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7. The MO HealthNet Managed Care health plans should all investigate the 
reasons forthe much lower match rates between diagnosisand procedures 


found by the EQRO during the 2007 report versus the rates found in the 2006 
report. 
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1.6 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


The purpose of the protocol to monitor health plan Compliance with Managed 
Care Regulationsisto provide an independent review of MO HealthNet Managed 
Care health plan activitiesand assessthe outcomes of timelinessand accessto the 
services provided by the health plan. The protocol requires the utilization of two 
main sources of information to determine compliance with federal regulations. 
These sources of information are document review and interviews with health plan 
personnel. Thiscombination of information was designed to provide the SMA witha 
better understanding of organizational performance at each MO HealthNet 


Managed Care health plan. 


The policy and practice in the operation of each health plan wasevaluated against 
the seventy (70) regulations related to operating a Medicaid managed care 
program. The regulations were grouped into three main categones: Enrollee Rights 
and Protections, Quality Assessment and Improvement, and Grievance Systems. 

The category of Quality Assessment and Improvement was subdivided into three 
subcategories: Access Standards, Structure and Operation Standards, and 
Measurement and Improvement. Initially, the SMA reviewed each MO HealthNet 
Managed Care health plan’s policy to determine compliance with the requirements 
of the MO HealthNet Managed Care Contract. These determinations and their 
application to the requirements of the federal regulations were assessed by the 
EQRO. The EQRO also focused on follow up to the findings reported in the 2005 and 
2006 reports by concentrating efforts of technical assistance and assessment on the 
items that were rated “Partially Met” or “Not Met” in those report years. Additional 
document review occured when the health plan policy submission did not meet 
MO HealthNet Managed Care contract requirements, or where clarification was 
necessary. An interview tool wasdeveloped for Member Services staff, Case 
Managers, and Plan Administrative Staff in the effort to validate that organizational 


practice wasin concert with approved policiesand procedures. The interviews 
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focused on the Member Services staff and the Case Managers, asthese are the 
individuals at each health plan who have direct contact with MO HealthNet 
Managed Care members. Administrative interviews were developed on-site and 
focused on clarification of responses received in the staff interview, particulany 
when a response wasincongruent with approved organizational policies, and 
explored issues that remained in question following the document review. It isnoted 
that five of the six MO HealthNet Managed Care plans were 100% compliant with 
not only producing policiesand procedures they met the requirements of the 
federal regulations, but also with practice that meets or exceeds these 
requirements. The one health plan that wasnot in full compliance is undergoing 
their first compliance review. They continue to work with the SMA to bring all written 
policy into compliance, but also to develop an array and method of service 


delivery that complies with federal and state requirements. 


QUALITY OF CARE 

Eight of the 13 regulations for Enrollee Rights and Protections were 100% “Met.” 
Communicating MO HealthNet Managed Care Members rightsto respect, privacy, 
and treatment options, as wellas communicating, orally and in writing, in theirown 
language or with the provision of interpretive servicesis an area of strength forall 
health plans. The MO HealthNet Managed Care health planscommunicated that 
meeting these requirements with members and providers, created an atmosphere 
with the expectation of delivering quality healthcare. The health plans maintained 
an awareness of and appropriate responsesto cultural and language bamiers 
conceming communication in obtaining healthcare. The health plans responded to 
physical, emotional and cultural bamers experienced by members with diligence 
and creativity. The health plans were aware of their need to provide quality 


servicesto membersin a timely and effective manner. 


Seven of the 10 regulations for Structure and Operations Standards were 100% 
“Met.” These included provider selection, and network maintenance, 


subcontractual relationships, and delegation. The health plans had active 
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mechanisms for oversight of all subcontractorsin place. All health plansimproved 
significantly in compliance with this set of regulations and articulated their 

understanding that maintaining compliance in thisarea enabled them to provide 


quality servicesto theirMO HealthNet Managed Care Members. 


ACCESS TO CARE 

Five of the MO HealthNet Managed Care health plans were fully compliant with the 
17 federal regulations conceming Access Standards. These included: provider 
networks; freedom of choice and access to all services; out-of-network services; 
timely access to Care; care coordination; authorization of services; approprnate 
notifications; timeliness of decisions regarding care and emergency and post- 
stabilization services. The sx MO HealthNet Managed Care health plans monitored 
high risk MO HealthNet Managed Care Membersand had active case 
management servicesin place. Each health plan described measures they used to 
identify and provide servicesto MO HealthNet Managed Care Members who have 
special healthcare needs. Many of these case management programs exceeded 
the strict requirements in the MO HealthNet Managed Care contract. All six health 
plans could describe efforts to participate in community events and forums to 
provide education to members regarding the use of PCPs, special programs 
available, and how to accesstheir PCP and other specialist service providers that 
might be required. The health plans were crucially aware of their responsbility to 
provide accessto care and services, and to communicate complete information on 


this topic to their members. 


TIMELINESS OF CARE 

Four of the 12 regulations for Measurement and Improvement were 100% “Met.” 
Five of the six MO HealthNet Managed Care health plans met all of the regulatory 
requirements. All six health plansadopted, disseminated and applied practice 
guidelinesto ensure sound and timely healthcare servicesfor members. The health 


plans used their health information systems to examine the appropriate utilization of 
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Care using national standard guidelines for utilization management. The health plans 
were beginning to utilize the data and demographics in their systems to track and 
trend information on members to assist in determinations of risk and prevention 
initiatives. Several health plans began using memberand community based quality 
improvement groupsto assist in determining bamersto services and methods to 
improve service delivery. The Member Servicesand Case Management 
departments had integral working relationships with the Provider Services and 
Relations Departments of the health plans. All front line staff and administrators 
interviewed exhibited a commitment to relationship building, as well as monitoring 
providers to ensure that all tandardsof care were met and that good service, 
decision-making, and sound healthcare practicesoccured on behalf of health 
plan members. The health plansall provided examples of how these relationships 
served to ensure that members received timely and effective healthcare. The 
health plan staff would contact providers directly to make appointments whenever 


members expressed diffic ulty in obtaining timely services. 


All 18 regulations for Grievance Systems were 100% “Met” for five of the health plans. 
One health plan (Harmony Health Care of Missoun) continues to work toward 
completion of adequate and approved policy with the SMA. The five remaining 
health plans were 100% compliant with the requirements for policy, procedure and 
practice in the area of Gnevance Systems. The health plans provided examples of 
how timely decision-making allowed membessto obtain their healthcare quickly 
and in the most appropriate setting. The health plans understood that maintaining 


this system wasan essential component to ensuring timely accessto healthcare. 


MO HealthNet Managed Care health plans remained invested in developing 
programsand providing services beyond the strict obligations of the contracts. 
Preventive health and screening initiatives exhibited a commitment to providing the 
best healthcare in the least invasive manner to their members. Partnerships with 
local universities and medical schools provided opportunities to obtain cutting-edge 


and occasionally experimental treatment options, which would not otherwise be 
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available to members. The health plans observed that these efforts combined to 


Create a system that allowed members timely accessto quality healthcare. 


RECOMMENDATIONS 


ip 


Continue to distribute the completed compliance toolsto the health plans to 
ensure recognition of the policiesand procedures that must be completed 
and approved to achieve compliance with federal regulations. 

MO HealthNet Managed Care health plans must continue to recognize the 
need fortimely submission of all required policy and procedures. The majority 
of the health plans put a tracking or monitoring system into place to ensure 
timely submission of documentation requiring annual approval. These 
systems must be maintained to ensure that this process remainsa priority for 
all health plans. 

MO HealthNet Managed Care health plans identified the need forcontinuing 
to monitor provider availability in theirown networks. Although most health 
plans had the number of primary care physicians (PCPs) and specialists 
required to operate, they admitted that many of these PCPshad closed 
panels and would not accept new patients. Ensuring that there is adequate 
access forall members, including new members, should be a prontty for all 
health plans. 

MO HealthNet Managed Care health plans identified improvement in their 
Quality Assessment and Improvement programs, and how this enhanced 
their ability to provide adequate and effective servicesto members. These 
efforts must be relentlessly continued to ensure that the organizations remain 
aware of areasforgrowth and improvement. These efforts ensure that the 
quality, timeliness and accessto care required for member services is 
maintained as exceptional levels as health planscontinued to struggle with 
recruitment of certain specialty physicians. 

MO HealthNet Managed Care health plans identified the need for additional 


dental providers. Recruitment was largely delegated to subcontractors. 
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Becoming actively involved in recruitment activities would benefit members 
and improve the quality of and accessto care. 
6. The use of data for quality improvement purmosesand examination of 
healthcare outcomes hasincreased dramatically. Continued growth in the 
utilization of allof the data available to drive healthcare practice and 


initiatives is required to improve quality and accessto care. 
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2.1 Definition 


A Performance Improvement Project (PIP) isdefined by the Centers for Medicare 
and Medicaid Services (CMS) as“a project designed to assessand improve 
processes, and outcomesof care...that isdesigned, conducted and reported ina 
methodologically sound manner.” The Validating Performance Improvement 
Projects Protocol specifies that the EQRO conduct three activities in the validation of 
two PiPsat each MO HealthNet Managed Care health plan that have been 
initiated, are underway, were completed during the reporting year, orsome 
combination of these three stages. The State Medicaid Agency (SMA: the 
Department of Social Services, MO HealthNet Division) elected to examine projects 
that were underway during the preceding calendar year 2007. Criteria for 
identification of a PIP as outlined in the CMS protocols include the following: 

e PiPsneed to have a pre-test, intervention, and post-test 

e PliPsneed to control for extraneous factors 

e PlIPsneed to include an entire population 

e Pilot projectsdo not constitute a PIP 

e Satisfaction studies alone do not constitute a PIP 

e Focused studiesare not PIPs: A focused study isdesigned to assess processes 

and outcomeson one-time basis, while the goal of a PIP isto improve 


processes and outcomes of care overtime. 


The State of Missoun contract forMO HealthNet Managed Care (C 30611801-07) 
describes the following requirements for MO HealthNet Managed Care health plans 
in conducting PIPs: 

Performance Improvement Projects: The health plan must conduct performance 
improvement projects that are designed to achieve, through ongoing 
measurements and intervention, significant improvement, sustained overtime, in 
Clinical care and nonclinical care areasthat are expected to have a favorable 
effect on health outcomesand member satisfaction. The health plan must report 
the status and results of each project to the state agency as requested. The 


performance improvement projects must involve the following: 
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e Measurement of performance using objective quality indicators. 

e Implementation of system interventions to achieve improvement in quality. 

e Evaluation of the effectiveness of the interventions. 

e Planning and initiation of activities for increasing or sustaining improvement. 

e Completion of the performance improvement project in a reasonable time 
period so asto generally allow information on the success of performance 
improvement projects in the aggregate to produce new information on 
quality of care every year. 

e Performance measures and topics for performance improvement projects 
specified by CMS in consultation with the state agency and other 
stakeholders. 


2.2 Purpose and Objectives 


The purpose and objectivesof the present review were to evaluate the soundness 
and results of PIPsimplemented by MO HealthNet Managed Care health plans 
during the calendar year 2007. The MO HealthNet Managed Care health plans 
were to have two active PIPsin place, one clinical and one nonclinical. The 
validation process examines the stability and variability in change over multiple 


years. 


2.3 Technical Methods 


There are three evaluation activities specified in the protocol for Validating 
Performance Improvement Projects. “Activity One: Assessing the MCOs/PIHPs 
Methodology forConducting the PIP” consists of ten steps: 


Activity One: Assessing the MCHPs /PIHPs Methodology for 
Conducting the PIP 





1. Step One: Review the selected study topic (s) 
2. Step Two: Review the study question(s) 
3. Step Three: Review selected study indicator(s) 
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Step Four: Review the identified study population 

Step Five: Review sampling methods (if sampling was used) 

Step Six: Review the MCHPs/PIHPs data collection procedures 
Step Seven: Assess the MCHPs/PIHPs improvement strategies 
Step Eight: Review data analysis and interpretation of study results 


oO ON OMB 


Step Nine: Assess the likelihood that reported improvement is “real” 
improvement 
10. Step Ten: Assess whether the MCHP/PIHP has sustained its 


documented improvement 











“Activity Two: Verifying PIP Study Findings’ is optional, and involves auditing PIP 
data. “Activity Three: Evaluate Overall Reliability and Validity of Study Findings” 
involves accessing whether the results and conclusions drawn from the PIP are valid 


and reliable. ActivitiesOne and Three were conducted by the EQRO. 


TIME FRAME AND SELECTION 

Two projects that were underway during the preceding 12 months at each MO 
HealthNet Managed Care health plan were selected for validation. The projects to 
be validated were reviewed with SMA and EQRO staff, in November 2007. The 
intent wasto identify projects which were mature enough for validation (i.e., 
planned and in the initial stages of implementation), underway orcompleted during 
calendar year 2007. The SMA made the final decision regarding the actual PIPs to 
be validated from the descriptions submitted by the MO HealthNet Managed Care 
health plans. 


PREPARATION OF MO HEALTHNET MANAGED CARE HEALTH PLANS 

All health plans were contacted during November 2007 to prepare them forthe 
2007 Extemal Quality Review. All health plans’ quality management staff or plan 
administrators were contacted to discuss the onset of the Extemal Quality Review 
Organization (EQRO) activities and to schedule training teleconferences in 


December. The health plans were explicitly requested to have all staff or 
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subcontractors available who would be responsible for obtaining and submitting the 
data required to complete all validation processes. During these teleconferences, 
all aspects of the EQR, including the requirements of submissions for the 


Performance Improvement Projects, were discussed. 


The training teleconference agenda, methodsand objectives, and schedule were 
sent to all health plans, following approval from the State Medicaid Agency (SMA), 
in early November 2007. SMA staff agreed to participate in these conference calls, 
allowing time for presentation of information, clarification, and questions. The 
Original submission of Performance Improvement Project subjects was scheduled 
priorto the end of November 2007. Submission of data wasscheduled for February 
through March 2008. This allowed for completion of all 2007 activities and 


compilation of initial data for projects underway in the previous year. 
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REVIEWERS 

Three reviewers conducted the Validating Performance Improvement Project 
Protocol activities, including interviews and document review. The Extemal Quality 
Review Organization (EQRO) Project Directorisa licensed attomey with a graduate 
degree in Health Care Administration, and seven years of experience in public 
health and managed care in two states. This washer third review. She conducted 
interviews and provided oversight to the PIP Protocol team. The Assistant Project 
Director wasconducting her fourth review. She hasexperience with the MO 
HealthNet Managed Care Program implementation and operations, interviewing, 
program analysis, and Medicaid managed care programs in other states, and 
thirteen years experience in program evaluation and research. The third reviewer 
participated in seven previous MO HealthNet Managed Care Program reviews and 
on-site visits. This reviewer was knowledgeable about the MO HealthNet Managed 
Care Program through herexpenence asa former SMA employee responsible for 
quality assessment and improvements, asan RN, and a consultant. All reviewers 
were familiar with the program improvement project requirements and validation 
process, aswell asresearch methods, and the requirements of the MO HealthNet 


Managed Care Program. 


2.4 Procedures for Data Collection 


The evaluation involved review of all materials submitted by the MO HealthNet 
Managed Care health plans including, but not limited to, the materials listed below. 
During the training teleconferences the health plans were encouraged to review 
Attachment B of the Validating Performance Improvement Projects Protocol and 
ensure that they include supporting documents, tools, and otherinformation 
necessary to evaluate the projects submitted, based on this tool. 

e Narrative descriptions 

e Problem identification 

e Hypotheses 

e Study questions 
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(PIPs) 
e Description of interventions(s) 
e Methodsof sampling 
e Planned analysis 
e Sample tools, measures, survey, etc. 
e Baseline data source and data 
e Cover letter with clarifying information 
e Overall analysis of the validity and reliability of each study 
e Evaluation of the results of the PIPs 


The EQRO Project Director, Assistant Project Director, and Review Consultant met 
with the MO HealthNet Managed Care health plan staff responsible for planning, 
conducting, and interpreting the findings of the PIPs during the on-site reviews 
occuning between J uly and August 2008. The review focused on the findings of 
projectsconducted during 2007. The health plans were instructed that additional 
information and data not available at the time of the original submission could be 
provided at the time of the on-site review orshortly thereafter. The time scheduled 
during the on-site review wasutilized to conduct follow-up questions, to review data 
obtained, and to provide technical assistance to health plans regarding the 
planning, implementation and credibility of findings from PIPs. In addition, individual 
clarifying questions were used to gather more information regarding the PIPs. The 
following questions were formulated and answered in the original documentation, 
or were posed to the health plans during the on-site review: 

e Who wasthe project leader? 

e How wasthe topic identified? 

e How wasthe study question determined? 

e What were the findings? 

e What were the interventions(s)? 

e What wasthe time pernod of the study? 

e Wasthe intervention effective? 

e What did the MO HealthNet Managed Care health plan want to leam from 

the study? 
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All PIPs were evaluated by the Review Consultant and the Assistant Project Director. 
In addition, the projects were reviewed with follow-up suggestions posed by the 
Project Director, who approved final ratings based on allinformation available to 


the team. 


ANALYSIS 

All PIPs submitted by MO HealthNet Managed Care health plans priorto the site 
visits were reviewed using an expanded version of the checklist for conducting 
Activity One, Steps 1 through 10, and Activity Three (J udgment of the Validity and 
Reliability of the PIPs) of the Validating Performance Improvement Projects Protocol, 
Attachment B (see Appendix 2). Because certain criteria may not have been 
applicable for projects that were underway at the time of the review, some specific 
items were considered as “NotApplicable.” Criteria were rated as “Met” if the item 
wasapplicable to the PIP, if there wasdocumentation addressing the item, and if 
the item could be deemed “Met” based on the study design. The proportion of 
items rated as “Met” wascompared to the total number of items that were 
applicable forthe particular PIP. Given that some PIPS were underway in the first 
year of implementation, it was not possible to judge or interpret: results; validity of 
improvement; or sustained improvements (Steps 8-10). The final evaluation of the 
validity and reliability of studies was based on the potential forthe studies to 
produce credible findings. Detailed recommendations and suggestions for 
improvement were made foreach item where appropriate, and are presented in 
the individual health plan summaries. Some itemsare rated as “Met” but continue 
to include suggestions and recommendationsasa method of improving the 
information presented. The following are the general definitions of the ratings 


developed for evaluating the PIPs. 


Met: Credible, reliable, and valid methods for the item were documented. 


Partially Met : Credible, reliable, or valid methods were implied or able to be established for part of the 


item. 


Not Met: The study did not provide enough documentation to determine whether credible, reliable, 
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and valid methods were employed; errors in logic were noted; or contradictory information 
was presented or interpreted erroneously. 


Not Applicable: Only to be used in Step 5, when there is clear indication that the entire population was 
included in the study and no sampling was conducted; or in Steps 8 through 10 when the 
study period was underway for the first year. 
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2.5 Findings 


Below are the PIPsidentified for validation ateach MO HealthNet Managed Care 
health plan: 


Biue-Advantage Ambulatory Follow-Up After Hospitalization for 
Plus Mental Health Disorders 


Training, Education and Restructuring the Work 
Flow of Member Grievances/Appeals, and 
Provider Complaints, Grievances/Appealsto 
Improve the Response Time to Membersand 
Providers 


Children’s Mercy Improving Non-Emergency Transportation Services 
Family Health 


Partners Improving Well-Child Visits First 15 months of Life 


Harmony Health Lead Screening 
Plan 


Medical Record Documentation by Primary Care 
Physicians (PCPs) and Their Staff/Interventions and 
Their Efficacy 

HealthCare USA Improving post-discharge management of 
members discharged from an inpatient service for 
mental illness 


Appealsand Grievances 


Mercy CarePlus Emergency Room Utilization 


Early Intervention in Prenatal Care Management 
and the Relationship to the Very Low Birth Weight 
Babies 


Missouri Care Increase Asthma Management 


Seven-day Follow-up Following Hospitalization for 
Mental Illness 
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STEP 1: SELECTED STUDY TOPICS 

Study topics were selected through data collection and the analysis of 
comprehensive aspectsof memberneeds, care, and services; and to addressa 
broad spectrum of key aspects of member care and services. In all cases they 
included all enrolled populations pertinent to the study topic without excluding 
certain members. Three of the 12 PIPs addressed follow-up care after discharge 
from hospitalization from mental illness; one addressed care formemberss with 
asthma and one addressed lead screening; one addressed access to care for 
pregnant members with the goal of reducing low birth weight infants; one 
addressed emergency room utilization; one addressed improving well-child visits in 
the first 15 months of life; two addressed improving the grievance and appeal 
processand one addressed transportation issues that led to gievances and 


appeals, and one addressed medical record documentation. 


Table 1 shows the ratings foreach item and PIP by MO HealthNet Managed Care 
health plan. Table 2 summanzesthe Performance Improvement Project validation 
ratings by item. The information provided in all 12 PIPsincluded a sound rationale 
that demonstrated the need forthe PIP and support forthe selection of the study 
topic. These project naratives all discussed literature supporting the activities to be 
undertaken and related the broad research reviewed to pertinent local issues. The 
narratives reviewed also provided some benchmark comparison data. While this 
section wasnot entirely perfect the health plans met all the criteria required 91.67% 
of the time. Each PIP addressed a broad spectrum of the key aspects of member 
Care and services (100% Met this critena; Step 1.2). Each health plan submitted one 
Clinical and one non-clinical intervention forreview. An array of aspectsof enrollee 
Care and services that were related to the identified problem was described. 
Utilization or cost issues may be examined through a PIP, but were not the sole focus 
of any study. There were adequate descriptions of the member populations 
targeted forintervention in the PIPs. During past reviews it was diffic ult to determine 
if the member populations addressed by the PIPs were MO HealthNet members, due 


to the vanety of populations served by the health plans (e.g., other state’s Medicaid 


Cé=— Performance Management Solutions Group 66 
erie A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 2 


Report of Findings - 2007 Validation of Performance Improvement Projects 
(PIPs) 

managed care members, commercial members, or Medicare members). The PIPs 
reviewed for 2007 did address MO HealthNet members exclusively, by all but one 
health plan. In addition, PIPs should specifically indicate whether all enrolled 
populations within the MO HealthNet Managed Care Program were included in the 
interventions. Finally, age and demographic characteristics should be described. 
All twelve of the PIPs (100%) Met these criteria (Step 1.3). 


Pectormaace Management 
jalutions Group 


_ : Performance Management Solutions Group 67 
ea tenes amma = O4E A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 2 
Report of Findings - 2007 Validation of Performance Improvement Projects (PIPs) 





Table 1 - Performance Improvement Project Validation Findings by MO HealthNet Managed Care Health Plan 
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Number Met 
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Number Partially Met 
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Number Not Met 
Number Applicable 23 24 24 24 


Rate Met 100.0% 100.0% 100.0% 86.7% 100.0% 100.0% 95.8% 52.6% 87.5% 100.0% 100.0% 


Note: Rate Met =Number Met/Number Applicable; 2 =Met; 1 =Partially Met ; 0 =Not Met; NA =Not Applicable; Item refers to the Protocol 
specific ations. 
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Source: BHC, Inc., 2007 Extemal Quality Review Performance Improvement Project Validation. 
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STEP 2: STUDY QUESTIONS 

Study questions are statements in the form of a question that describe the potential 
relationship between the intervention, the intended outcome, and the data to be 
obtained and analyzed. The questions must be specific enough to suggest the 
study methodsand outcome measures. The health plans made a concerted effort 
to ensure that statements were provided in the form of a question, and in all cases 
the questions were directly related to the hypotheses and topic selected. Twelve 
(100%) of the PIPsincluded clearly stated study questions (Step 2.1). The study 
purposes identified were consistent with the remainder of the PIP (the target 


population, interventions, measures, or methods) in most instances. 


Table 2- Summary of Performance Improvement Project Validation Ratings by Item, All MC HPs 
All MC+ MCOs 


Tumber Tumber Tumber al Number 
Ses ES] Partially Met | Not Met | Applicable Rate Met 
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1.3 12 100.00% 
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Step 10: Sustained Improvement 10.1 
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Note: Percent Met =Number Met/ Number Applicable; Item refers to the Protocol specifications 
Source: BHC, Inc., 2007 Extemal Quality Review Performance Improvement Project Validation 


ET Ga. Performance Management Solutions Group 
TP OH A division of Behavioral Health Concepts, Inc. 70 


MO HealthNet Managed Care Extemal Quality Review Section 2 
Report of Findings - 2007 Validation of Performance Improvement Projects 
(PIPs) 


STEP 3: STUDY INDICATORS 

A majority of the PIPs “Met” the criteria fordefining and describing the calculation 
of study indicators. Eleven (91.67%) of the PIPs Met the criteria for using objective, 
clearly defined, measurable indicators while one wasrated as Partially Met (Step 
3.1). The calculation of measures was described and explained. Even when well- 
known measures were used (e.g., Health Employer Data Information Set; HEDIS; 
Consumer Assessment of Health Plans Survey; CAHPS), there wasa detailed 
description of the methods (e.g., Administrative or Hybrid Method) and formulas for 
calculating the measures. Again, because the health plans vary in their method of 
calculation, details regarding the measures and methodsof calculating those 
measures should be included in PIPs. All but one of the 12 PIPs identified and 
detailed at least one study indicator that was related to health or functional status; 
orto processes of care strongly associated with outcomes. Eleven of the 12 (91.67%) 
were rated as “Met” (Step 3.2); and one was Partially Met. The link between the 
intervention and the outcomes measured by the PIP should be explicit in the 


narrative. 


STEP 4: STUDY POPULATIONS 

The health plans all made an attempt to meet the criteria for adequately defining 
the study population. The evaluation examines if all the MO HealthNet Managed 
Care Program Membersto whom the study question(s) and indicators) were 
relevant are included. All twelve PIPs (100%) did include adequate information to 
make this determination (Step 4.1). All PIPS, including those considered non-clinical, 
defined the applicable study population being considered. The selection criteria 
should clearly describe the MO HealthNet Managed Care Member populations 
included in the PIP and theirdemographic characteristics. Eleven of the 12 PIPs 
(92%) described data collection approaches indicating that data forall members to 


whom the study question applied were collected (Step 4.2). In allcasesthere wasa 
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description that at least allowed inference of how data were collected and how 


members were identified. 


STEP 5: SAMPLING METHODS 

Sampling techniques were utilized in one of the PlPsreviewed. The health plan 
(Harmony Health Plan of Missoun) employed true sampling techniques. The type of 
sample (e.g., convenience, random) orsampling methods (e.g., simple, cluster, 
stratified) were described in detail. All required critena for corect use of a sampling 


methodology were included. 
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STEP 6: DATA COLLECTION PROCEDURES 

All twelve (12) of the PIPs described the data to be collected with adequate detail 
and a description of the units of measurement used (Step 6.1). Eleven of 12 (91.67%) 
PIPs clearly specified the sources of data (e.g., claims, members, providers, medical 
records) foreach measure (Step 6.2). Some health plans used the National 
Committee for Quality Assurance (NCQA) Quality Improvement Activity (QIA) Form 
to write up their PIP narrative. Thisform providesa structure forreporting measures 
and data sources. However, when there is more than one source of data, it is 
important that the health plan specifically states the sourcesof data foreach 
measure. The health plans were reminded that the strict use of this format limits the 
narrative and explanation that must accompany the PIP in order forthe EQRO to 
validate each element. Eleven of 12 PIPs (91.67%) clearly described systematic and 
reliable methods of data collection (Step 6.3). There wassome description of the 
data collection proceduresin all cases. It isnot possible to judge the reliability or 
credibility of any PIP without sufficient detail regarding data collection processes, 
procedures, orfrequency. Eleven of the PlPs used a data collection instument that 
wasdescribed in detail. Eleven provided information on the methods or instruments 
to be used to collect data. In one cas the information was not presented ina 
method which allowed that consistent and accurate data would be collected over 
time (Step 6.4). In one case the health plan did not provide adequate information 
to determine if accurate data would be collected overtime. However, ten (83.33%) 


“Met” this element, while two “Partially Met” this element. 


When using surveys, medical records, ortelephone protocols for data collection, it is 
important to provide the tool for review, discuss the piloting of the tool, and discuss 
training and interrater reliability for the recording of information on the tool. 
Standard providerand consumer surveys provide manuals describing the 
characteristics of instruments that should be incorporated into the nanative of the 
PIP. A sufficient level of detail, including sample copies of instruments utilized, was 


provided in the narrative for all PIPs. The PIPs provided the parameters for the 
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Calculation of these measures and included sufficient information to make a 


judgment for this validation element. 


Ten of the PIPs (83.33%) included a complete data analysis plan, while two 
additional PIPs were rated Partially Met forspecifying a plan (Step 6.5). All PIP 
narratives included some information that prospectively specified a data analysis 
plan. Thisplan should be developed prorto the implementation of the PIP, be 
based on the study questions, explain the expected relation between the 
intervention(s) and outcome(s) being measured (i.e. independent and dependent 
vanables), and include the method(s) of data collection, and the nature of the 


data (e.g., nominal, ordinal, scale). 


All twelve PIPs identified the project leaders, the staff involved in the PIP, and their 
qualifications in the narrative submitted. They also identified who wasinvolved in or 
provided oversight forthe design, implementation, data analysis, and interpretation 
of the PIP (Step 6.6). Health plan staff interviewed on-site included team members 
who were involved and knowledgeable about the PIPsand methods. Additional 
information about all the PIP team members and their qualifications and roleswere 
not orginally provided in the namative, but were clarified with the submission of 
additional information after the time of the on-site review. This information provided 


additional clarification and validity to the processand the measures. 


STEP 7: IMPROVEMENT STRATEGIES 

All twelve (100%) of the PlIPs identified reasonable interventions to address the 
bamiers identified through data analysisand quality improvement processes 
undertaken. The nature of identification of the bamiers, a description of bamiers, and 
a plan for addressing bamers was described and discussed during the on-site 


review. 


STEP 8: DATA ANALYSIS AND INTERPRETATION OF STUDY RESULTS 


(a Performance Management Solutions Group 
erie A division of Behavioral Health Concepts, Inc. 74 


MO HealthNet Managed Care Extemal Quality Review Section 2 
Report of Findings - 2007 Validation of Performance Improvement Projects 
(PIPs) 

Ten of the 12 PiPS were mature enough to present data to analyze. These health 
plans (100%) conducted their analyses according to the data analysis plan (Step 
8.1). Of the ten PIPs that presented baseline or re-measurement data, they each 
(100%) presented numencal findings accurately and clearly (Step 8.2). In some 
instances, data were presented in formats that originally lacked explanatory 
narrative. This issue was discussed with the health plans at the on-site review. 
Revisions and updates were received that provided adequate explanation of data 
and the information presented. Axis labels and units of measurement should be 
reported in Table and in Figure legends. This information should be clearly 


identifiable to the reader. 


Of the ten PIPsthat presented at least one re-measurement period, eight (80.0%) 
indicated the re-measurement period forall of the measures identified in the study 
(Step 8.3). Of the ten PIPs describing the findings, nine (90.0%) described the extent 


to which the intervention was effective (Step 8.4). 
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STEP 9: VALIDITY OF IMPROVEMENT 

Six PIPs (100%) with re-measurement points used the same method at re- 
measurement as the baseline measurement (Step 9.1). Whenever possible the 
baseline measure should be recalculated consistent with the re-measurement 
method to ensure validity of reported improvement and comparability of 
measurement overtime. One PIP did explain that the MO HealthNet eligibility 
criteria changed during the measurement year. How this change was incomorated 
into the baseline information was cleany explained and documented. The same 
source of measures should also be used at re-measurement points. Four of the five 
PIPs (80%) that were mature enough to include data analysis employed statistical 
significance testing to document quantitative improvements in care (Step 9.2). They 
were able to show sgnificant improvement over multiple re-measurement points, 
however, this improvement was not always statistic ally significant. These five (100%) 
PIPs reported improvements that had face validity, meaning that the reported 
improvement was judged to have been related to the intervention applied (Step 
9.3). These PIPs provided some discussion or interpretation of findings by health 
plans. Additional narative in thisarea would ensure proper evaluation of all data 
and information provided. Thiswas another area that improved after providing 
technical assistance at the time of the on-site review. The need for narative 
summaries of the information and data provided wasstressed with the health plans. 
After reporting findings, there should be some interpretation asto whether the 
intervention or other factors may have accounted forimprovement, decline, orlack 
of change. Fourof the five PIPs (80%) that had reached a level of maturity to 
include this data did provide statistical evidence that the observed improvement 
wastrue improvement (Step 9.4). Then, bamiers should be identified and addressed 
forthe next cycle of the PIP, orreasons for discontinuing the PIP should be 
described. It wassuggested that the discussion of bamiers be integrated into the 
disc ussion of each intervention. How identified bamers create unforeseen variables 
in the PIP outcomes was another factor that should be addressed in the nanative 


documentation presented foreach PIP. 
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STEP 10: SUSTAINED IMPROVEMENT 

Of the four PIPs examining multiple measurement points overtime, three (75%) PIPs 
used statistical significance testing to demonstrate improvement. These three (75%) 
showed statistic ally significant improvement over several measurement points. One 
PIP (25%) did not provide adequate information to justify that any sustained 
improvement would occur. The low numbersin this area are a function of the lack 
of maturity that many of the PIPs exhibited. The PiPsthat did indicate that there was 
observed improvement asthe result of the interventions provided through this 
processall included statements that these interventions will become part of the 


health plans’ regular operations. 


2.6 Conclusions 


Acrossall health plans, the range in proportion of criteria that were “Met” foreach 
PIP validated was 52.6% through 100% (See Table 1). Thiscomparesto a rate of 
25.0% through 100% in 2006. Acrossall PIPs validated statewide, 93.57% of criteria 
were met which indicatesa significant increase overthe 2006 rate of 75.0%. It 
should also be noted that the results in 2007 reflect statistics for twelve PIPs reviewed, 
while the 2006 results reflect ten PIPs reviewed. The quality and depth of the PIPs 
submitted reflect a continued commitment and improvement to the Performance 
Improvement Project process throughout all of the MO HealthNet Managed Care 
health plans. Allsources of available data were used to develop the ratings forthe 
PIP items. The EQRO comments were developed based on the written 
documentation and presentation of findings. In all cases, there was enough 
information provided to validate the PIPs. On-site interviews and subsequent 
information provided revealed the depth of commitment the majority of the health 
plans have developed in utilizing the PIP processto improve organizational process 


and outcomes. 


All of the PIPs presented included thoughtful and complex information. In some of 


the PIPs, enhanced information obtained at the on-site review, made it clearthat 
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the health plan intended to use this processto improve organizational functions and 
the quality of services available ordelivered to members. In several cases the 
performance improvement project had already been incorporated into health plan 
daily operations. PlPsare to be ongoing, with periodic re-measurement points. At 
least quarterly re-measurement is recommended to provide timely feedback to the 
MO HealthNet MCHP regarding the need to address baniers to implementation. 
Health plan personnel involved in PIPs had extensive experience in clinical service 
delivery, quality improvement, and monitoring activities. It wasclear that they had 
made a significant improvement and investment in designing valid evaluation 
studies using sound data collection and analysis methods. This requires technical 


expertise in health services research and/or program evaluation design. 


Based on the PIP validation process, at least fourhealth plans (Children’s Mercy 
Family Health Partners, Blue-Advantage Plus of Kansas City, HealthCare USA, and 
Missouri Care) had active and ongoing PiPsaspart of their quality improvement 
programs. One health plan (Mercy CarePlus) continues to improve their utilization of 
the PIP processaSa tool to develop their performance and improve services to 
members. Harmony Health Plan of Missouri submitted PIPs for review for the first time 
during this Extemal Quality Review. HHP’s interventions included projects that are 
ongoing in both their Missoun and Illinoisoperations. The quality of HHP’s PIPs 
indicated a thorough understanding of the use of the performance improvement 
project asmethod of enhancing and improving member services. A continually 
improving commitment to the quality improvement process was observed during 
the on-site review at each health plan. With each submission it isnoted that the 
complexity and maturity of the PIP processhas improved from prorsubmissions. This 
is further evidence that the performance improvement project process has become 


an integral part of all MO HealthNet Managed Care health plans’ operations. 


Table 3 - Validity and Reliability of Performance Improvement Project Results 
PIP Name 


Emergency Room Utilization 
2 sf Moderate Confidence 





Early Intervention in Prenatal Care Management High Confidence 
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Appeals and Grievances . 
Moderate Confidence 


Post-Discharge Management after Inpatient Mental Health Treatment 
S 2 High Confidence 


Lead Screenin 
g Moderate Confidence 


Medical Record Review 
Moderate Confidence 


Appropriate Use of Asthma Medications 
Ene oes High Confidence 


7-Day Follow-Up After Hospitalization for Mental I IIness 
. P PE High Confidence 


Well-Child Visits in the First 15 Months of Life : 
Moderate Confidence 


Improving Non-Emergency Transportation Services 
P g gene P High Confidence 


Ambulatory Follow-Up After Mental Health Hospitalization 
a P P Moderate Confidence 


Appeals Process Compliance 
ie P Moderate Confidence 





Note: Not Credible =There is little evidence that the study will ordid produce results that could be 
attributed to the intervention(s); Low Confidence =Few aspects of the PIP were described or 
performed ina mannerthat would produce some confidence that findings could be attributed to the 
intervention(s); Moderate Confidence =Many aspects of the PIP were described or performed ina 
manner that would produce some confidence that findings could be attributed to the intervention(s); 
High Confidence =The PIP study wasconducted or planned in a methodologically sound manner, with 
intemal and extemal validity, tandard measurement, and data collection practices, and appropriate 
analyses to calculate that there isa high level of confidence that improvements were a result of the 
intervention. A 95%to 99% level of confidence in the findings was or may be able to be demonstrated. 
Source: BHC, Inc., 2007 Extemal Quality Review Performance Improvement Project Validation 


Table 3 indicates the overall confidence rating forall of the PIPs submitted. This 
table reflectsan improvement in the confidence levels achieved in the 2006 PIPS. 
The following summarizes the quality, access, and timeliness of care assessed during 
this review, and recommendations based on the findings of the Validation of 


Performance Improvement Projects activity. 


ACCESS TO CARE 

Accessto care wasan important theme addressed throughout all the PIP 
submissions reviewed. Five of the PIPs utilized enhanced case management 
proceduresto ensure that membershad accessto care, were reminded of 
appointments, and that case managers were available to ensure that bamiers to 


services were decreased. Two health plans focused on education and support to 
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obtain appropnate services and medications forthe treatment of asthma and 
access to lead screening (Missoun Care and Harmony Health Plan). All the projects 
reviewed used the format of the PIP to improve accessto care formembers. Three 
of the projects cleanly focused on ensuring the members had adequate and timely 
access to services after being hospitalized for mental health related issues 
(HealthCare USA, Missouri Care, BA+). The on-site disc ussions with health plan staff 
indicate the realization that improving accessto care isan ongoing aspect of all 
projects that are developed. One health plan (Mercy CarePlus), developed an 
ongoing PIP into a project that providescase management servicesto all pregnant 
members. As outcome data are finalized, and asan example of both improved 
accessand quality of care, this project should become a best practice to be 


shared throughout the health plans. 


QUALITY OF CARE 

Topic identification was an area that provided evidence of the attention placed on 
providing quality servicesto members. Intervention development for PIPs also 
focused on the issue of quality services. All PIPSreviewed focused on topics that 
needed improvement, either in the intemal processes used to operate the health 
plan, orin the direct provision of servicesdelivered. The comesponding interventions 
that address bamiers to quality care and health outcomes were cleany evident in 
the narratives submitted. There was further evidence of a commitment to quality of 
care during on-site discussion at each health plan, including the desire to supply 
supplemental and updated information to ensure that project effortsand outcomes 
were clearly reported. These interventions addressed key aspects of enrollee care 
and services, such as medication and treatment management; risk identification 
and stratification for various levels of care; monitoring provider accessand quality 
services; and preventive care. These efforts exemplified an attention to quality 


healthcare services. 


TIMELINESS OF CARE 
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Timeliness of care wasthe major focus of a numberof the PiPs reviewed. Three 
projectsidentified the need fortimely aftercare for members who required inpatient 
hospitalization for mental illness (HealthC are USA, Missouri Care, and BA+). The 
remaining projects focused on subjects such as timely processing and resolution of 
gnevancesand appeals (HealthCare USA, and BA+), appropriate medications and 
treatment for asthma (Missoun Care), improved access to non emergent 
transportation services (Children’s Mercy Family Health Partners), improved access 
to well-child visits in the first 15 months of life (Children’s Mercy Family Health 
Partners). Alladdressed the need fortimely accessto preventive and primary 
health care services. The health plansall related theirawareness of the need to 
provide not only quality, but timely services to members. Projects reflected this 
awareness in that they addressed intemal processes and direct service 


improvement. 


RECOMMENDATIONS 

1. Itisrecommended that health planscontinue to refine their skills in the 
development and implementation of the Performance Improvement 
Projects. Improved training, assistance and expertise forthe design, statistic al 
analysis, and interpretation of PIP findings are available. One health plan 
(Children’s Mercy Family Health Partners) continues to utilize the servicesofa 
statistician from a local university to ensure valid and reliable findings. 

2. In the design of PIPs, the health plans need to use generally accepted 
practices for program evaluation to conduct PIPs. In addition to training on 
the development of PIPsand on-site technical assistance, referencesto the 
CMS protocol, “Conducting Performance Improvement Projects” were 
recommended by the EQRO at each health plan asa guideline to frame the 
development, reporting and analysis of the PIP. 

3. PlPsshould be conducted onan ongoing basis, with at least quarteny 
measurement of some indicesto provide data about the need forchanges 


in implementation, data collection, orinterventions. 
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4. PiPsthat are not yet complete should include narrative reflecting next steps 
and a plan for how the PIP willbe maintained and enhanced for future years. 
5. Itappearsthat in most instancesthe health plans conduct PIPson an 
ongoing bass aspart of their quality improvement program. Continuing to 
utilize these PIPs astoolsto improve the organizations’ ability to serve 


members is beneficial. 
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3.1 Definition 


The EQRO isrequired by the Validating Performance Measures Protocol to evaluate 
three performance measures reported by each MO HealthNet MCHP. These 
measures are selected by the State Medicaid Agency each year (SMA; the Missouri 
Department of Social Services MO HealthNet Division; MHD). Forthe HEDIS 2007 
evaluation penod, the three performance measures selected for validation were 
Annual Dental Visits (ADV), Adolescent Well-Care Visits (AWC), and Follow-Up After 
Hospitalization for Mental Illness (FUH). Protocol activities performed by the EQRO for 
this audit included: 1) Review of the processes used by the MO HealthNet health 
plans to analyze data; 2) Evaluation of algorithmic compliance with performance 
measure specifications: and 3) Recalculation of eitherthe entire set of performance 
measure data (administrative rates) ora subset of the data (hybrid rates) to verify 
and confim the rates reported by the health plans are based upon accurate 


Calculations. 


3.2 Purpose and Objectives 


The objectives for validating performance measures were to: 1) evaluate the 
accuracy of Medicaid performance measures reported by, oron behalf of, MO 
HealthNet Managed Care health plans; and 2) determine the extent to which MO 
HealthNet Managed Care health plan-specific performance measures calculated 
by the health plans (or by entities acting on behalf of the health plans) followed 
specifications established by the SMA and the State Public Health Agency (SPHA; 
Missour Department of Health and Senior Services; DHSS) for the calculation of the 


performance measure(s). 


REVIEWERS 

Interviews, document review, and data analysis activities for the Validating 
Performance Measure Protocol were performed by two reviewers from the Extemal 
Quality Review Organization (EQRO). The Project Director conducted interviews 


and document review; she isa licensed attomey with a graduate degree in Health 
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Care Administration, as well as seven years experience in public health and 
managed care in two states. Thisisherthird Extemal Quality Review. Data analysis 
and interviews were conducted by the EQRO Research Analyst, who isan 
Information Technology specialist with a Bachelors Degree in Computer Science 
and a Masters Degree in Business Administration. She has worked for over four years 


managing data in large and small databases. 


3.3 Technical Methods 


Reliable and valid calculation of performance measuresisa critical Component to 
the EQRO audit. These calculations are necessary to calculate statewide rates, 
compare the performance of MO HealthNet Managed Care health plans with other 
MO HealthNet Managed Care health plans, and to compare State and health plan 
performance with national benchmarked data for Medicaid Managed Care and/or 
Commercial Managed Care Organization members. These types of comparisons 
allow for better evaluation of program effectiveness and accessto care. The EQRO 
reviewed the selected data to assessadherence to State of Missoun requirements 
forMO HealthNet Managed Care health plan performance measurement and 
reporting. The Missour Code of State Regulations (19 CSR § 10-5.010 Monitoring 
Health Maintenance Organizations) contains provisions requiring all Health 
Maintenance Organizations (HMOs) operating in the State of Missouri to submit to 
the SPHA member satisfaction survey findings and quality indicator data in formats 
conforming to the National Committee for Quality Assurance (NCQA) Health 
Employer Data Information Set (HEDIS) Data Submission Tool (DST) and all other 
HEDIS Technical Specifications? for performance measure descriptions and 
calculations. The State of Missouri contract forMO HealthNet Managed Care 

(C 30611801-07, Revised Attachment 6, Quality Improvement Strategy) further 
stipulates that MO HealthNet health plans will follow the instructions of the SPHA for 
submission of HEDIS measures. The three measuresselected by the SMA for 
validation were required to be calculated and reported by MO HealthNet 
Managed Care health plansto both the SMA and the SPHA forMO HealthNet 





° National Committee for Quality Assurance. HEDIS 2007, Volume 2: Technical Specifications. Washington, 
D.C.: NCQA. 
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Managed Care Members. A review wasconducted for each of the three 
measures selected based upon the HEDIS 2007 Technical Specifications. These 


specifications are provided in the following tables: 
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HEDIS 2007 ADOLESCENT WELL-CARE VISITS (AWC) 


The following isthe definition of the Adolescent Well-Care Visits measure, a Use of 
Services measure?°, and the specific parametersasdefined by the NCQA. 
The percentage of enrolled members who were 12-21 years of age 
and who had at least one comprehensive well-care visit with a primary 
care practitioner oran OB/GYN practitioner during the measurement 


year. 


Table 4 - HEDIS 2007 Technical Specifications for Adolesc ent Well-C are Visits (AWC ) 
|. Eligible Population 


Product lines Commercial, Medicaid (report each product line separately). 

Ages 12-21 years as of December 31 of the measurement year. 

Continuous The measurement year. 

enrollment 

Allowable gap Members who have had no more than 1 gap in enrollment of up to 45 days 


during the measurement year. To determine continuous enrollment for a 
Medicaid member for whom enrollment is verified monthly, the member may not 
have more than a 1-month gap in coverage (i.e., a member whose coverage 
lapses for 2 months [60 days] is not considered continuously enrolled). 


Anchor date December 31 of the measurement year. 
Benefit Medical. 
Event/diagnosis None. 





Il. Administrative Specification 


Denominator The eligible population. 


Numerators At least one comprehensive well-care visit with a primary care practitioner or an 
OB/GYN practitioner during the measurement year. The primary care 
practitioner does not have to be assigned to the member. Adolescents who had 
a claim or encounter with a primary care practitioner or OB/GYN practitioner with 
one of the codes listed below are considered to have received a comprehensive 
well-care visit: 


99383-99385, 99393-99395, V20.2, V70.0, V70.3, V70.5, V70.6, V70.8, V70.9 





10 This measure has the same structure as measuresin the Effectiveness of Care domain. The MCO 
should follow Specific Guidelines for Effectiveness of Care Measures when calculating this measure. 
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Ill. Hybrid Specification 


Denominator A systematic sample drawn from the MCO’s eligible population. The MCO may 
reduce its sample size using the current year’s administrative rate or the prior year’s 
audited, product line-specific rate. 


Note: For information on reducing sample size, refer to the Guidelines for 
Calculations and Sampling. 


Numerators At least one comprehensive well-care visit with a primary care practitioner or an 
OB/GYN practitioner during the measurement year, as documented through either 
administrative data or medical record review. 


The primary care practitioner does not have to be assigned to the member. 


Administrative Refer to the Administrative Specification listed above to identify positive numerator 
hits from the administrative data. 


Medical record Documentation in the medical record must include, a note indicating a visit to a 
primary care practitioner or OB/GYN practitioner, the date on which the well-care 
visit occurred and, evidence of all of the following. 


e A health and developmental history (physical and mental) 
e A physical exam 


e Health education/anticipatory guidance 
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An MCHP that submits HEDIS data to NCQA must provide the following data 


elements: 


Table 5 - Data Hements for Adolesc ent Well-Care Visits 
| Administrative | Hybrid 
Measurement year 


Data collection methodology (administrative or hybrid) 
Eligible population 


Oversampling rate Ps 
Final sample size (FSS P| 
Number of numerator events by administrative data in FSS Ps 


; echt 
Number of numerator events by administrative data in eligible population (before exclusions) 
Current year’s administrative rate (before exclusions) 

Minimum required sample size (MRSS) or other sample size 


Fhunertrevensbyadninstaieda SSS 
[Nunertorevensbynedealenas —~=~C~*~“‘(C*C*C*~“‘<CS 
Reootae SS SOSO—S—SOSSSOTCCCS Sid 


<i S 
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HEDIS 2007 FOLLOW-UP AFTER HOSPITALIZATION FOR MENTAL ILLNESS 
(FUH) 


The following is the definition of the Follow-Up After Hospitalization for Mental Illness 
measure, an Effectiveness of Care measure, and the specific parameters as defined 
by the NCQA. 

The percentage of discharges for members 6 years of age and older 

who were hospitalized for treatment of selected mental health 

disordersand who were seen on an outpatient basis or were in 


intermediate treatment with a mental health provider. 


Table 6 - HEDIS 2007 Technical Specific ations for Follow-Up After Hospitalization for Mental Illness (FUH) 





|. Eligible Population 


Product lines Commercial, Medicaid, Medicare (report each product line separately). 
Ages 6 years and older as of the date of discharge. 

Continuous Date of discharge through 30 days after discharge. 

enrollment 

Allowable gap No gaps in enrollment. 

Anchor date None. 

Benefits Medical and mental health (inpatient and outpatient). 


Event/ diagnosis Discharged from an inpatient setting of an acute care facility (including acute care 
psychiatric facilities) with a discharge date occurring on or before December 1 of the 
measurement year and a principal |CD-9-CM Diagnosis code indicating a mental health 
disorder specified below: 


295-299, 300.3, 300.4, 301, 308, 309, 311-314, 426, 430 


The MCO should not count discharges from nonacute care facilities (e.g., residential 
care or rehabilitation stays). 


Multiple A member with more than one discharge on or before December 1 of the measurement 
discharges year with a principal diagnosis of a mental health disorder (Table FUH-A) could be 
counted more than once in the eligible population. 
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Mental health If the discharge for a selected mental health disorder is followed by readmission or 
readmission or direct transfer to an acute facility for any mental health principal diagnosis within the 
direct transfer 30-day follow-up period, count only the readmission discharge or the discharge from 


the facility to which the member was transferred. 


Although rehospitalization might not be for a selected mental health disorder, it is 
probably for a related condition. Only readmissions with a discharge date that occurs on 
or before December 1 of the measurement year are included in the measure. Refer to 
the ICD-9-CM codes listed in Table MIP-A. 


Exclude discharges followed by readmission or direct transfer to a nonacute facility for 
any mental health principal diagnosis within the 30-day follow-up period. These 
discharges are excluded from the measure because readmission or transfer may 
prevent an outpatient follow-up visit from taking place. (Refer to Table NON-A for codes 
to identify nonacute care.) 


Non-mental Exclude discharges in which the patient was transferred directly or readmitted within 30 
health days after discharge to an acute or nonacute facility for a non-mental health principal 
readmission or diagnosis. These discharges are excluded from the measure because rehospitalization or 
direct transfer transfer may prevent an outpatient follow-up visit. 


Denied claims Denials of inpatient care (e.g., those resulting from members failing to get proper 
authorization) are not excluded from the measure. 





Il. Administrative Specification 


Denominator The eligible population. 


Note: The eligible population for this measure is based on discharges, not 
members. It is possible for the denominator for this measure to contain 
multiple discharge records for the same individual. 


Numerators An outpatient mental health encounter or intermediate treatment with a 
mental health practitioner within the specified time period. For each 
denominator event (discharges), the follow-up visit must occur after the 
applicable discharge. An outpatient visit on the date of discharge should be 
included in the measure. 


30-day follow-up An outpatient follow-up encounter with a mental health practitioner up to 30 
days after hospital discharge. To identify outpatient follow-up encounters, 
use the CPT codes or the UB-92 revenue codes in Table FUH-B. 


7-day follow-up An outpatient follow-up encounter with a mental health practitioner up to 7 
days after hospital discharge. To identify outpatient follow-up encounters, 
use the CPT codes or the UB-92 revenue codes in Table FUH-B. 


Ill. Hybrid Specification 


None. 


Table FUH-B: C odes to Identify Outpatient Mental Health Enc ounters or Intermediate Treatment 


Description —_| CPT | HCPCS UB-92 Revenue * 
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Outpatient or 90801, 90802, 90804-90819, 90821-90824, G0155, G0176, G0177, 0513, 0900, 0901, 
intermediate care 90826-90829, 90845, 90847, 90849, 90853, H0002, H0004, H0031, 0905-0907, 0909-0916, 
90857, 90862, 90870, 90871, 90875-90876, H0034-H0037, H0039, 0961 


99201-99205, 99211-99215, 99241-99245, H0040, H2000, H2001, 
99341-99345, 99347-99350, 99383-99387, H2010-H2020, M0064, 
99393-99397, 99401-99404, 99510 $9480, $9484, S9485 





*The MCO doesnot need to determine practitioner type for follow-up visits identified through UB-92 
Revenue codes. 
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An MCHP that submits HEDIS data to NCQA must provide the following data 


elements: 


Table 7 - Data Hements for Follow-Up After Hospitalization for Mental Illness (FUH) 
| Administrative 


Data colesion mefiadoogy(adninevaiv) ———~=~C~*~“‘CSCS*~‘“‘CSONOC‘SCSS 
Feigbiepopaton SSCS 


v 
v 
Each 
Upper 95% confidence interval 
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HEDIS 2007 ANNUAL DENTAL VISIT (ADV) 


The following is the definition of the Annual Dental Visit measure, an Effectiveness of 


Care measure, and the specific parameters as defined by the NCQA. 


The percentage of enrolled members 2-21 years of age who had at 
least one dental visit during the measurement year. This measure 
applies only if dental care isa covered benefit in the MCO’s Medicaid 


contract. 


Table 8 - HEDIS 2007 Technical Specifications for Annual Dental Visit (ADV) 
|. Eligible Population 


Product line Medicaid. 
Ages 2-21 years as of December 31 of the measurement year. The measure is 
reported for each of the following age stratifications and as a combined rate. 
e 2-3-years e 11-14-years e 19—21-years 
e 4-6-years e 15-18-years e Total 
e 7-10-years 
Continuous The measurement year. 
enrollment 
Allowable gap No more than 1 gap in enrollment of up to 45 days during the measurement year. 
To determine continuous enrollment for a Medicaid beneficiary for whom 
enrollment is verified monthly, the member may not have more than a 1-month 
gap in coverage (i.e., a member whose coverage lapses for 2 months [60 days] is 
not considered continuously enrolled). 
Anchor date December 31 of the measurement year. 
Benefit Dental. 


Eventidiagnosis None. 





Il. Administrative Specification 


Denominator The eligible population for each age group and the combined total. 


Numerator One or more dental visits with a dental practitioner during the measurement year. 
A member had a dental visit if a submitted claim/encounter contains any of the 
codes in Table ADV-A. 


Ill. Hybrid Specification 


None. 
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Table ADV-A: Codes to Identify Annual Dental Visits 
CPT | HCPCSICDT-3 ICD-9-CM Procedure 





70300, 70310, 70320, D0120-D0999, D1110-D2999, D3110-D3999, D4210- | 23, 24, 87.11, 87.12, 89.31, 93.55, 96.54, 97.22, 
70350, 70355 D4999, D5110-D5899, D6010-D6205, D7111-D7999, | 97.33-97.35, 99.97 
D8010-D8999, D9110-D9999 


Note: C urrent Dental Terminology (CDT) isthe equivalent dental version of the C PT physician 
procedural coding system. 


An MCHP that submits HEDIS data to NCQA must provide the following data 


elements: 


Table 9 - Data Hements for Annual Dental Visits 
Administrative 


Measurement year 


v 
Data collection methodology (administrative) 


For each age stratification and total 


For each age stratification and total 
For each age stratification and total 
For each age stratification and total 


Upper 95% confidence interval For each age stratification and total 
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METHODS OF CALCULATING PERFORMANCE MEASURES 

The HEDIS technical specifications provide fortwo possible methods of calculating 
performance measures: 1) the Administrative Method and 2) the Hybrid Method. 
Of the measures selected for this review, only the Adolescent Well-Care Visits 
measure pemnits the use of eitherthe Administrative or Hybrid methods; Annual 
Dental Visit and Follow-Up After Hospitalization for Mental Illness must each be 


calculated using the Administrative Method. 


The Administrative Method involves examining claims and other databases 
(administrative data) to calculate the number of memberss in the entire eligible 
population who received a particular service (e.g., well-child visits, dental visits or 
follow-up visits). The eligible population isdefined by the HEDIS technical 
specifications. Those casesin which administrative data show that the member 
received the service(s) examined are considered “hits”, or “administrative hits.” The 
HEDIS technical specifications provide acceptable administrative codes for 
identifying an administrative hit. 

Forthe Hybrid Method, administrative data are examined to select members eligible 
forthe measure. From these eligible members, a random sample is taken from the 
approprnate measurement year. Members in the sample are identified who 
received the service(s) as evidenced by a claim submission or through extemal 
sources of administrative data (e.g., State Public Health Agency Vital Statistics or 
Immunization Registry databases). Those casesin which an administrative hit 
cannot be determined are identified for further medical record review. 
Documentation of all orsome of the servicesin the medical record alone orin 


combination with administrative data isconsidered a “hybrid hit.” 


Administrative hits and hybrid hits are then summed to form the numerator of the 
rate of members receiving the service of interest (e.g., appropriate doctor's visit). 
The denominator of the rate is represented by the eligible population (administrative 
method) or those sampled from the eligible population (hybrid method). A simple 
formula of dividing the numerator by the denominator produces the percentage 
(also called a “rate”) reported to the SMA and the SPHA. 
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Additional guidance is provided in the HEDIS 2007 Technical Specifications: Volume 
2" forapproprate handling of situations involving oversampling, replacement, and 


treatment of contraindic ations for services. 





11 National Committee for Quality Assurance. HEDIS 2007, Volume 2: Technical Specifications. Washington, 
D.C.: NCQA. 
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TIME FRAME 

The propertime frame forselection of the eligible population foreach measure is 
provided in the HEDIStechnical specifications. Forthe measuresselected, the 
“measurement year’ referred to calendar year (CY) 2006. All events of interest (e.g. 


follow-up visits) must also have occured during CY2006. 


PROCEDURES FOR DATA COLLECTION 

The HEDIS 2007 technical specifications foreach measure validated were reviewed 
by the EQRO Project Director and the EQRO Research Analyst. Extensive training in 
data management and programming for healthcare quality indices, clinical 
training, research methods, and statistical analysis expertise were well represented 
among the personnel involved in adapting and implementing the Validating of 
Performance Measures Protocol to confom to the HEDIS, SMA, and SPHA 
requirements while maintaining consistency with the Validating Performance 
Measures Protocol. The following sections describe the procedures for each activity 
in the Validating Performance Measures Protocol asthey were implemented forthe 
three HEDIS 2007 measures validated. 


Pre-On-Site Activity One: Reviewer Worksheets 
Reviewer Worksheets were developed forthe purpose of conducting activities and 
recording observations and comments for follow-up at the site visits. These 
worksheets were reviewed and revised to update each specific item with the HEDIS 
2007 technical specifications. Project personnel met throughout November and 
December 2007 to review available source documents and develop the Reviewer 
Worksheets for conducting pre-on-site, on-site, and post-on-ste activities as 
described below. These reviews formed the basisforcompleting the CMS Protocol 
Attachments (V, VII, X, XIl, XIll, and XV) of the Validating Performance Measures 
Protocol foreach measure and MO HealthNet Managed Care health plan. Source 
documents used to develop the methods for review and complete the Attachments 
included the following: 

e HEDIS 2007 Data Submission Tool (DST) 
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e HEDIS 2007 Baseline Assessment Tool (BAT) 
e HEDIS 2007 Audit Report 
e HEDIS 2007 SPHA Reports 


Pre-On-Site Activity Two: Preparation of MO HealthNet MCOs 

Onentation teleconferences with each MO HealthNet MCHP were conducted from 
December 3, 2007 through December 14, 2007 by the EQRO. The purpose of this 
Orientation conference wasto provide education about the Validating 
Performance Measures protocol and the EQRO’s submission requirements. All 
written matenals, letters and instructions used in the orentation were reviewed and 
approved by the SMA in advance. Prorto the teleconference calls, the MO 
HealthNet Managed Care health plans were provided information on the technical 
objectives, methods, procedures, data sources, and contact information for EQRO 
personnel. The health plans were requested to have in attendance the person(s) 
responsible forthe calculation of the HEDIS 2007 performance measures validated. 
Teleconference meetings were led by the EQRO Project Director, with key project 
personnel and a representative from the SMA in attendance. Provided via the 
teleconferences was technical assistance focused on describing the Validating 
Performance Measures Protocol; identification of the three measures selected for 
validation; the pupos, activitiesand objectives of the EQRO; and definitions of the 
information and data needed forthe EQRO to validate the performance measures. 
AllMO HealthNet Managed Care health plan questions about the process were 
answered at this time and identified for further follow-up by the EQRO if necessary. 
In addition to these teleconference calls, presentations and individual 
communications with personnel at MO HealthNet Managed Care health plans 
responsible for HEDIS 2007 performance measure calculation were conducted 
between December 2007 and J une 2008, with follow-up telephone callsand written 


communications continuing as necessary through J uly 2008. 


On December 20, 2007, formal written requests fordata and information for the 
validation of performance measures were submitted to the MO HealthNet 


Managed Care health plansby the EQRO. Thisinformation wasto be retumed to 
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the EQRO by J anuary 28, 2008 (see Appendix 3). A separate written request was 
sent to the health planson February 13, 2008 requesting medical recordsbe 
submitted to the EQRO fora sample of cases. These records were to be submitted 
by the providers to the EQRO by March 24, 2008. Detailed letters and instructions 
were mailed to QI/UM Coordinatorsand MO HealthNet Managed Care health plan 
Administrators explaining the type of information, purpose, and format of 
submissions. EQRO personnel were available and responded to electronic mail and 
telephone inquines and any requested clarifications throughout the evaluation 
process. The following are the data and documents requested from MO HealthNet 
Managed Care health plans forthe Validating Performance Measures Protocol: 

e HEDIS 2007 Data Submission Tool forall three measures forthe MO HealthNet 
Managed Care Population only. 

e 2007 HEDIS Audit Report. 

e Baseline Assessment Tool for HEDIS 2007. 

e List of cases for denominator with all HEDIS 2007 data elements specified in 
the measures. 

e List of cases for numerators with all HEDIS 2007 data elements specified in the 
measures, including fields forclaimsdata and all other administrative data 
used. 

e All worksheets, memos, minutes, documentation, policies and 
communications within the health plan and with HEDIS auditors regarding the 
calculation of the selected measures. 

e List of casesfor which medical records were reviewed, with all HEDIS 2007 
data elements specified in the measures. 

e Sample medical record tools used forhybrid methods forthe three HEDIS 
2007 measures forthe MO HealthNet Managed Care population; and 
instructions for reviewers. 

e Policies, procedures, data and information used to produce numerators and 
denominators. 

e Policies, procedures, and data used to implement sampling (if sampling was 
used). Ata minimum, this should include documentation to facilitate 


evaluation of: 
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o Statistical testing of resultsand any corrections or adjustments made 
after processing. 

o Description of sampling techniques and documentation that assures 
the reviewer that samples used forbaseline and repeat measurements 
of the performance measures were chosen using the same sampling 
frame and methodology. 

o Documentation of calculation forchanges in performance from 
previous penods (if comparisons were made), including tests of 
statistical significance. 

e Policiesand procedures formapping non-standard codes, where applicable. 

e Record and file formatsand descriptions for entry, intermediate, and 
repository files. 

e Electronic transmission proceduresdocumentation. (This will apply if the 
health plan sends or receives data electronically from vendors performing the 
HEDIS abstractions, calculations or data entry) 

e Descriptive documentation for data entry, transfer, and manipulation 
programs and processes. 

e Samplesof data from repository and transaction filesto assessaccuracy and 
completeness of the transfer process. 

e Documentation of properrun controls and of staff review of report runs. 

e Documentation of results of statistical tests and any correctionsor 
adjustments to data along with justification for such changes. 

e Documentation of sources of any supporting extemal data orprior years’ 
data used in reporting. 

e Procedures to identify, track, and link member enrollment by product line, 
product, geographic area, age, sex, member months, and member years. 

e Proceduresto track individual members through enrollment, disenrollment, 
and possible re-enrollment. 

e Proceduresused to link member monthsto memberage. 

e Documentation of “frozen” orarchived files from which the samples were 
drawn, and if applicable, documentation of the health plan’s processto re- 


draw a sample orobtain necessary replacements. 
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e Proceduresto capture data that may reside outside the health plan’sdata 
sets (e.g. MOHSAIC). 
e Policies, procedures, and materials that evidence proper training, supervision, 
and adequate tools for medical record abstraction tasks. (May include 


training maternal, checks of inter-rater relia bility, etc.) 


Pre-On-Site Activity Three: Assess the Integrity of the MC HP's Information System 
The objective of this activity wasto assessthe integrity of the MO HealthNet 
Managed Care health plans’ ability to link data from multiple sources. All relevant 
documentation submitted by the MO HealthNet Managed Care health plans was 
reviewed by EQRO personnel. The review protocols indicate than an Information 
Systems Capability Assessment (ISCA) be administered every other year. The 2006 
review year contained a full ISCA analysis; therefore, a new ISCA wasnot 
conducted forthe 2007 review. EQRO personnel also reviewed HEDIS 2007 Baseline 
Assessment Tool (BAT) submitted by each health plan. Detailed notesand follow-up 


questions were formulated forthe site visit reviews. 
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On-Site Activity One: Assess Data Integration and Contol 
The objective of this activity wasto assess the MO HealthNet Managed Care health 
plans’ ability to link data from multiple sourcesand determine whether these 
processes ensure the accurate calculation of the measures. A seriesof interviews 
and in-depth reviews were conducted by the EQRO with MO HealthNet Managed 
Care health plan personnel (including both management and technical staff and 
37 party vendorswhen applicable). These site visit activities examined the 
development and production procedures of the HEDIS 2007 performance measures 
and the reporting processes, databases, software, and vendors used to generate 
these rates. Thisincluded reviewing data processing issues for generating the rates 
and determining the numeratorand denominatorcounts. Other activities involved 
reviewing database processing systems, software, organizational reporting 
structures, and sampling methods. The following are the activitiesconducted at 
each health plan: 

e Review results of run queries (on-site observation, screen-shots, test output) 

e Examination of data fields fornumerator & denominator calculation 

(examine field definitions and file content) 

e Review of applications, data formats, flowcharts, edit checksand file layouts 

e Review of source code, software certification reports 

e Review HEDIS repository procedures, software manuals 

e Test forcode capture within system for measures (confirm principal & 

secondary codes, presence/absence of non-standard codes) 
e Review of operating reports 
e Review information system policies (data control, disaster recovery) 


e Review vendorassociations & contracts 
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The following are the interview questions developed for the ste visits: 
e What are the processes of data integration and control within information 
systems? 
e What documentation processesare present forcollection of data, teps 
taken and proceduresto calculate the HEDIS measures? 
e What processesare used to produce denominators? 
e What processesare used to produce numerators? 
e How issampling done forcalculation of rates produced by the hybrid 
method? 
e How doesthe MCHP submit the requirement performance reports to the 
State? 


From the site visit activities, interviews, and document reviews, Attachment V (Data 
Integration and Control Findings) of the CMS Protocol wascompleted foreach MO 


HealthNet Managed Care health plan and performance measure validated. 


On-Site Activity Two: Assess Documentation of Data and Processes Used to 
Calculate and Report Performance Measures 


The objectives of this activity were to assess the documentation of data collection, 
assess the processof integrating data into a performance measure set, and 
examine procedures used to query the data set to identify numerators, 


denominators, generate a sample, and apply properalgorithms. 


From the ste visit activities, interviews, review of numeratorand denominator files 
and document reviews, Attachment VII (Data and Processes Used to Calculate and 
Report Performance) of the CMS Protocol wascompleted foreach MO HealthNet 
Managed Care health plan and measure validated. One limitation of this step was 
the inability of the health plansto provide documentation of processes used to 
calculate and report the performance measures due to the use of proprietary 
software or off-site vendor software and claimssystems. However, all MO HealthNet 


Managed Care health plans were able to provide documentation and flow-charts 
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of these systems to illustrate the general methods employed by the software 
packagesto calculate these measures. 
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On-Site Activity Three: Assess Proc esses Used to Produce the Denominators 

The objectives of this activity were to: 1) to determine the extent to which all eligible 
members were included; 2) to evaluate programming logic and source codes 
relevant to each measure; and 3) to evaluate eligibility, enrollment, age, codes, 


and specifications related to each performance measure. 


The content and quality of the data files submitted were reviewed to facilitate the 
evaluation of compliance with the HEDIS 2007 technical specifications. The MO 
HealthNet Managed Care health plans consistently submitted the requested level of 
data (e.g., allelements required by the measures or information on hybrid or 
administrative data). In orderto produce meaningful results, the EQRO required 
that all the health plans submit data in the format requested. Although corrected 
data had to be requested, all MO HealthNet Managed Care health plans did 
submit the data requested in the proper format priorto completion of the validation 


process. 


From the site visit activities, interviews, review of numeratorand denominator files 
and document reviews, Attachment X (Denominator Validation Findings) of the 
CMS Protocol wascompleted foreach MO HealthNet Managed Care health plan 


and performance measure validated. 


On-Site Activity Four: Assess Processes Used to Produce the Numerators 

The objectives of this activity were to: 1) evaluate the MO HealthNet Managed Care 
health plans’ ability to accurately identify medical events (e.g., appropriate 
doctor's visits); 2) evaluate the health plans’ ability to identify events from other 
sources (e.g., medical records, State Public Immunization Registry); 3) assess the use 
of codesfor medical events; 4) evaluate procedures for non-duplication of event 
counting; 5) examine time parameters; 6) review the use of non-standard codes 
and maps; 7) identify medical record review procedures (Hybrid Method); and 8) 


review the processof integrating administrative and medical record data. 
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Validation of the numerator data forall three measures wasconducted using the 
parameters specified in the HEDIS 2007 Technical Specifications; these parameters 
applied to datesof service(s), diagnosis codes, and procedure codesappropnate 
to the measure in question. The Annual Dental Visit measure, forexample, requires 
that all dates of service occured between J anuary 1, 2006 and December 31, 2006. 
Visits outside this valid date range were not considered. Similar validation was 
conducted forall three measures reviewed. Thisnumerator validation was 
conducted on either all numerator cases (Administrative Method) orona sample of 
cases (Hybrid Method). 


Additional validation for measurescalculated using the Hybrid Method wasalso 
conducted. The Protocol requires the EQRO to sample up to 30 records from the 
medical records reported by the MO HealthNet Managed Care health planas 
meeting the numerator criteria (hybrid hits). In the event that the health plan 
reported fewerthan 30 numerator events from medical records, the EQRO 
requested all medical records that were reported by the health plan as meeting the 
numerator critena. Thisapproach did not apply to the Follow-Up After 
Hospitalization for Mental Illness or Annual Dental Visit measures, asthe 
Administrative Method of calculation is required forthese measures by HEDIS 


technical specifications. 


Initial requests fordocuments and data were made on December 20, 2007, with 
submissions due to the EQRO by J anuary 28, 2008. The EQRO required the MO 
HealthNet Managed Care health plansto request medical records from the 
providers. On February 13, 2008, the MO HealthNet Managed Care health plans 
were given a list of medical recordsto request, a letter from DMS explaining the 
purpose of the request, and the information necessary for the providers to send the 
medical recordsdirectly to the EQRO. The submission deadline for medical records 
was March 24, 2008. The record receipt rate wasexcellent; of the 60 records 


contained in the sample, all 60 were received by the EQRO for review. 
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The review of medical records was administered by Reliable HealthCare Services, 
Inc. (RHS), a temporary healthcare services provider located in Kansas City, Missouri 
and a Business Associate of Behavioral Health Concepts, Inc., (the EQRO). RHSisa 
State of Missouri certified Minority-Owned Business Enterprise (MBE) operated by two 
registered nurses. RHS possesses expertise in recruiting nursing and professional 
health care staff forclinical, administrative, and HEDIS medical record review 
services. The review of medical records wasconducted by RNs with over 20 years of 
Clinical experience and who were curently licensed and practicing in the State of 
Missoun. Two RNs participated in the training and medical record review process 
and both had atleast five years of experience conducting medical record reviews 


for HEDIS measures. 


A medical record abstraction tool forthe Adolescent Well-Care Visits measure was 
developed by the EQRO Project Director and revised in consultation with a nurse 
consultant, the EQRO Research Analyst, and with the input from the nurse reviewers. 
The 2007 HEDIS technical specifications and the Validating Performance Measures 
Protocol criteria were used to develop the medical record review tools and data 
analysis plan. A medical record review manual and documentation of ongoing 
reviewer questions and resolutions were developed forthe review. A half day of 
training wasconducted by the EQRO Project Directorand staff on March 31, 2008 
using sample medical record toolsand reviewing all responses with feedback and 
discussion. The reviewertraining and training manual covered content areas such 
as Health Insurance Portability and Accountability Act (HIPAA), confidentiality, 
conflict of interest, review tools, and project background. Teleconference meetings 
between the nurses, coders, and EQRO Project Director were conducted as 
needed to resolve questions and coding discrepancies throughout the duration of 


the medical record review process. 


A data entry format with validation parameters was developed foraccurate 
medical record review data entry. A data entry manual and training were provided 
to the data entry person at RHS, Inc. Data wasreviewed weekly foraccuracy and 


completeness, with feedback and conections made to the data entry person. The 
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final databases were reviewed for validity, verified, and cormected priorto 
performing analyses. Alldata analyses were reviewed and analyzed by the EQRO 
Research Analyst and reviewed, approved and finalized by the EQRO Project 
Director. CMS Protocol Attachments XIl (Impact of Medical Record Findings) and 
XIll (Numerator Validation Findings) were completed based on the medical record 


review of documents and site visit interviews. 


On-Site Activity Five: Assess Sampling Process (Hybrid Method) 
The objective of this activity wasto assess the representativeness of the sample of 
care provided. 
e Review HEDIS Baseline Assessment Tool (BAT) 
e Review Data Submission Tool (DST) 
e Review numeratorand denominator files 
e Conduct medical record review for measures calculated using hybrid 
methodology 
e Determine the extent to which the record extract files are consistent with the 
data found in the medical records 
e Review of medical record abstraction tools and instructions 
e Conduct on-site interviews, activities, and review of additional 


documentation 


For those health plans that calculated the Adolescent Well-Care Visits measure via 
hybrid methodology, a sample of medical records (up to 30) wasconducted to 
validate the presence of an appropriate well-child visit that contributed to the 


numerator. 


From the review of documents and ste visits, CMS Protocol Attachment XV 
(Sampling Validation Findings) was completed for those MO HealthNet Managed 
Care health plansthat elected the Hybrid Method forthe HEDIS 2007 Adolescent 


Well-Care Visits measure. 
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On-Site Activity Six: Assess Submission of Required Performance Measures to State 
The objective of this activity wasto assure proper submission of findingsto the SMA 
and SPHA. 


The DST was obtained from the SPHA to determine the submission of the 
performance measures validated. Conversations with the SPHA representative 
responsible for compiling the measures forall MO HealthNet Managed Care health 
plans in the State occured with the EQRO Project Director to clarify questions, 


obtain data, and follow-up on health plan submission status. 


Post- On-Site Activity One: Determine Preliminary Validation Findings for each 
Measure 


Calculation of Bias 

The CMS Validating Performance Measures Protocol specifies the method for 
calculating biasbased on medical record review forthe Hybond Method. In addition 
to examining bias based on the medical record review and the Hybrid Method, the 
EQRO calculated biasrelated to the inappropriate inclusion of cases with 
administrative data that fell outside the parameters described in the HEDIS 2007 
Technical Specifications. For measurescalculated using the Administrative Method, 
the EQRO examined the numerators and denominators for correct date ranges for 
datesof birth and datesof service aswell asconect enrollment periods and codes 
used to identify the medical events. Thiswasconducted asdescribed above under 
on-site activities three and four. The estimated bias in the calculation of the HEDIS 
2007 measures forthe Hybrid Method wascalculated using the following 
procedures, methodsand formulas, consistent with the Validating Performance 


Measures Protocol. Specific analytic proceduresare described in the following 


section. 
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Analysis 

Once the medical record review wascomplete, all administrative data provided by 
the MO HealthNet Managed Care health plans in their data file submissions for the 
HEDIS 2007 Adolescent Well-Care Visits measure were combined with the medical 
record review data collected by the EQRO. Thisallowed forcalculation of the final 
rate. In orderforeach event of a well-care visit to be met, there had to be 
documented evidence of an appropriate well-care visit code asdefined in the 
HEDIS 2007 Technical Specifications; sick visits oremergency room codeswere not 
included. Only one well-care visit in the measurement year was required fora 
member to be considered a postive “hit”. Multiple well-care visits for one member 
within the measurement year were excluded; each member was only counted 


once. 


Forthe calculation of bias based on medical record review forthe MO HealthNet 
Managed Care health plans using the Hybrid Method for the HEDIS 2007 Adolescent 
Well-Care Visits measure, several steps were taken. First, the number of hits based 
on the medical record review wasreported (Medical Records Validated by EQRO). 
Second, the Accuracy (number of Medical Records able to be validated by 
EQRO/total number of Medical Records requested by the EQRO for audit) and Enor 
Rates (100% - Accuracy Rate) were determined. Third, a weight foreach Medical 
Record wascalculated (100%/denominator reported by the health plan) as 
specified by the Protocol. The number of False Postive Records wascalculated 
(Eror Rate * numerator hits from Medical Records reported by the health plan). This 
represents the number of recordsthat were not able to be validated by the EQRO. 
The Estimated Bias from Medical Records was calculated (False Positive Rate * 
Weight of Each Medical Record). 


To calculate the Total Estimated Biasin the calculation of the performance 
measures, the Administrative Hits Validated by the EQRO (through the previously 
described file validation process) and the Medical Record Hits Validated by the 
EQRO (asdescribed above) were summed and divided by the total Denominator 
reported by the MCHP on the DSTto determine the Rate Validated by the EQRO. 
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The difference between the Rate Validated by the EQRO and the Rate Reported by 
the MO HealthNet Managed Care health plan to the SMA and SPHA wasthe Total 
Estimated Bias. A positive number reflects an overestimation of the rate by the 


health plan, while a negative number reflects an underestimation. 
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Once the EQRO concluded its on-ste activities, the validation activity findings for 
each performance measure were aggregated. This involved the review and analysis 
of findingsand Attachments produced foreach performance measure selected for 
validation and for the health plan’s Information System asa result of pre-on-site and 
on-site activities. The EQRO Project Director reviewed and finalized all ratingsand 
completed the Final Performance Measure Validation Worksheets for all measures 
validated foreach of the MO HealthNet Managed Care health plans. Ratings for 
each of the Worksheet items (0 =Not Met; 1 =Partially Met; 2 =Met) were summed 
foreach worksheet and divided by the number of applicable items to form a rate 
for comparison to other MO HealthNet Managed Care health plans. The worksheets 
foreach measure were examined by the EQRO Project Director to complete the 
Final Audit Rating. 

Below isa summary of the final audit rating definitions specified in the Protocol. Any 
measures not reported were considered “Not Valid.” A Total Estimated Bias outside 
the 95% upper or lower confidence limits of the measures as reported by the MO 


HealthNet Managed Care health plan on the DST wasconsdered “Not Valid”. 


Fully Compliant: Measure was fully compliant with State (SMA and SPHA) 
specifications. 


Substantially Measure was substantially compliant with State (SMA and SPHA) 
Compliant: specifications and had only minor deviations that did not 
significantly bias the reported rate. 


Not Valid: Measure deviated from State specifications such that the reported 
rate was significantly biased. This designation is also assigned to 
measures for which the data provided to the EQRO could not be 
independently validated. 


‘Significantly Biased’ was defined by the EQRO as being outside 
the 95% confidence interval of the rate reported by the MO 
HealthNet Managed Care health plan on the HEDIS 2007 Data 
Submission Tool. 
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3.4 Findings 


MO HealthNet Managed Care health plansconduct the calculation of 
performance measures in collaboration with a variety of vendors and use a number 
of different management information systemsto extract data forthe calculation of 
measures. They are also required to undergo annual audits by NCQA-certified 
auditing firms that provide MO HealthNet Managed Care health plans with 
recommendations for reporting or not reporting findings of specific measuresto the 
NCQA. Regardless of the NCQA audit rating or rotation, the health plans are 
required to report the performance measures validated to the SMA and SPHA. 
Table 10 summarizes the names of HEDIS-certified software used, medical record 
vendors, and HEDIS auditors foreach of the MO HealthNet Managed Care health 


plans. 


Table 10 - HEDIS 2007 Software, Vendors, and Auditors forthe HEDIS 2007 Measures 
IY FeVist= Wey mu (=Le | Cer-] | Name of HEDIS 2007 
MO HealthNet MCHP Name of Software Record Vendor Neliveyg 


Blue-Advantage Plus of Software from ViPs, 
Kansas City Inc. MedMeasures* QMark/HEDISHelp Ernst & Young, LLP 


Children’s Mercy Family Software from ViPs, Children’s Mercy Family 

Health Partners Inc. MedMeasures* Health Partners Healthcare Data.com, LLC 
CareEnhance 
Resource 
Management 

Harmony Health Plan Software (CRMS)* UNI VAL Healthcare Data.com, LLC 
Quality Spectrum* 
HEDIS repository by 
Catalyst Not Applicable. Did not 

HealthCare USA Technologies use Hybrid Method. Healthcare Data.com, LLC 


Healthcare Research 
Mercy CarePlus Amisys (Novasys) QMark/HEDISHelp Associates 
Quality Spectrum* 
HEDIS repository by 
Catalyst 
Missouri Care Technologies Missouri Care Thomson MedStat 


Note: * NCQA-certified 
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Table 11 showsthe method of calculation used by each MO HealthNet Managed 


Care health plan. Thisinformation wastaken from the MO HealthNet Managed 
Care health plans’ self-report to the EQRO. 


Table 11 - Summary of Method of Calculation Reported and Validated by MO HealthNet Health Plans 


Follow-Up After 
Adolescent Well- Annual Dental Hospitalization 
MO HealthNet MCHP Care Visits Visit for Mental Illness 





Blue-Advantage Plus of Kansas City Administrative Administrative Administrative 
Children’s Mercy Family Health Partners Hybrid Administrative Administrative 
Harmony Health Plan N/A N/A N/A 


HealthCare USA Administrative Administrative Administrative 


Mercy CarePlus Administrative Administrative Administrative 


Missouri Care Hybrid Administrative Administrative 


The validation of each of the performance measures is discussed in the following 
sections with the findings from each validation activity described. Subsequent 
sections summarize the status of submission of the measures validated to the SMA 


and SPHA, the Final Audit Ratings, and conclusions. 


HEDIS 2007 ANNUAL DENTAL VISIT 


Data Integration and Contol 

The objective of this activity wasto assess the MO HealthNet Managed Care health 
plans’ ability to link data from multiple sources. It isbased on the integrity of the 
management information systems and the ability to ensure accuracy of the 
measures. For the HEDIS 2007 Annual Dental Visit measure, the sourcesof data 
included enrollment, eligibility, and claim files. Table 12 summarizes the findings of 
Attachment V (Data Integration and Control Findings) of the CMS Protocol. The rate 
of items that were met wascalculated acrossMO HealthNet Managed Care health 


plansand from the numberof applicable items foreach health plan. Ofallthe MO 
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HealthNet Managed Care health plansthat calculated the measure, 100% Met all 
criteria forevery audit element Assuch, each health plan Met 100% of the criteria 


fordata integration and control. 
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Table 12 - Data Integration and Contol Findings, HEDIS 2007 Annual Dental Visit Measure 


MO HealthNet ‘MCHP | _ All Mo HealthNet MCHPs 





Number Number er | Number 
Audit Elements Sth Hcus® NOcarE [Eee Neti Partially Mety ce EBICANG Rate aL 


MCHP/PIHP- processes 25 accurately and completely transfer 

data from the transaction files (e.g., membership, provider, 

encounter/claims) into the repository used to keep the data 

until the calculations of the performance measures have been 

completed and validated. 100.0% 


MCHP’s/PIHP’s processes to consolidate diversified files, and 

to extract required information from the performance 

measure repository are appropriate. 2 2 2 2 2 5 5 100.0% 
Procedures for coordinating the activities of multiple 

subcontractors ensure the accurate, timely, and complete 

integration of data into the performance measure database. 2 2 2 2 5 5 100.0% 


@ repository’s design, program flow charts, and source 
5.7 codes enable analyses and reports. 2: 5 5 100.0% 


xamine and assess the adequacy of the documentation 
governing the production process, including MCHP/PIHP 
production activity logs, and MCHP/PIHP staff review of 
report runs. 100.0% 
The MCHP/PIHP has retained copies of files or databases used 
for performance measure reporting, in the event that results 
5.11 need to be reproduced. 100.0% 


Review the MCHP’s/PIHP’s processes and documentation to 

determine the extent to which they comply with the 

MCHP/PIHP standards associated with reporting program 

specifications, code review, and testing. 100.0% 


MumperPonawWet | | oe | 
NumberRorwet 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met ; O =Not Met, validated through HEDIS 
software certification process, but no proper explanation of the processin documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Documentation of Data and Processes 

The objectives of this activity were to assess the documentation of data collection; 
the process of integrating data into a performance measure set; the procedures 
used to query the data set forsampling numerators and denominators; and the 
ability to apply properalgorithms. The findings of Attachment VI (Data and 
Processes Used to Calculate and Report Performance Measures) of the CMS 
Protocol are summarized in Table 13. Items 7.2, 7.3, 7.5, 7.7, 7.9, and 7.10 did not 
apply to thismeasure. All MO HealthNet Managed Care health plans (100.0%) Met 
the criteria forapplying appropriate data and processes forthe calculation of the 
HEDIS 2007 Annual Dental Visit measure. 
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Table 13 - Data and Processes Used to Calc ulate and Report Performance Measures, HEDIS 2007 oma Dental Visit 










MO HealthNet MCI MCHPO i All MO HealthNet MCHPs 


r 
| 
Number Number Not Number 
Item Audit Elements BA+ CMFHP HCUSA MOCare i Met } Partially Met Met Applicable Rate Met 


| | 
Statistical testing of results and any corrections or 
7.3 adjustments made after processing. NA NA NA NA NA 


Detailed medical record review methods and practices, 

including the qualifications of medical record review 

supervisor and staff; reviewer training materials; audit tools 

used, including completed copies of each record-level 

reviewer determination; all case-level critical performance 

measure data elements used to determine a positive or 

negative event or exclude a case from same; and inter-rater 

reliability testing procedures and results. NA NA NA NA NA 


Data that are related from measure to measure are 

consistent (e.g., membership counts, provider totals, number 

of pregnancies and births). NA NA NA NA NA NA 
When determining improvement in pertormance between 

measurement periods, appropriate statistical methodology is 

epplled:to.determine levels ot significance ot: changes; Le | re re Pa Loe | le = bai la 


Number Not Met cps de fe pe 


Number Applicable Pos | os | s | ss | s | 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Metand validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met; O=Not Met, validated through HEDIS 
software certification process, but no proper explanation of the processin documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 

Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 


























If sampling used, description of sampling techniques, and 
documentation that assures the reviewer that samples used 
for baseline and repeat measurements of the performance 
measures were chosen using the same sampling frame and 
methodology. 














25 100.0% 







Number Partially Met 
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Processes Used to Produce Denominators 

The objective of this activity wasto determine the extent to which all eligible 
members were included in the denominator, evaluate the programming and logic 
source codes, and evaluate the specifications forcalculating each measure. Table 
14 summarizes the findings of Attachment X (Denominator Validation Findings) of 
the CMSProtocol. Items 10.5 (Identification of gender of the member), 10.6 
(Calculation of member months or years), and 10.10 (Systems for estimating 
populations when they are unable to accurately be counted) were not applicable 
to this measure. Of the five MO HealthNet Managed Care health plansreviewed, 


100% Met the criteria for producing denominators according to specific ations. 
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Table 14 - Denominator Validation Findings, HEDIS 2007 Annual Dental Visit 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Nu r 
Audit Elements BA+ Partially Met Met Applicable Rate Met 


All members who were eligible to receive the specified services 

were included in the initial population from which the final 

denominator was produced. This “at risk" population included 

both members who received the services, as well as those who 

did not. This same standard applies to provider groups or other 

relevant populations identified in the specifications of each 

performance measure. 100.0% 


For each measure, programming logic or source code which 

identifies, tracks, and links member enrollment within and 

across product lines (e.g., Medicare and Medicaid), by age and 

sex, as well as through possible periods of enrollment and 

disenrollment, has been appropriately applied according to the 

specifications of each performance measure. 100.0% 


Calculations of continuous enrollment criteria were correctly 
carried out and applied to each measure (if applicable). 100.0% 


Proper mathematical operations were used to determine 
patient age or range. 100.0% 


The MCHP/PIHP can identify the variable(s) that define the 
member's sex in every file or algorithm needed to calculate the 
performance measure denominator, and the MCHP/PIHP can 
explain what classification is carried out if neither of the 
required codes is present.* 


The MCHP/PIHP has correctly calculated member months and 
member years, if applicable to the performance measure.* 


The MCHP/PIHP has properly evaluated the completeness and 
accuracy of any codes used to identify medical events, such as 
diagnoses, procedures, or prescriptions, and these codes have 
been appropriately identified and applied as specified in each 
performance measure. 


Any time parameters required by the specifications of the 

performance measure are followed (e.g., cut off dates for data 

collection, counting 30 calendar days after discharge from a 

hospital, etc.). 100.0% 


members from a denominator were followed. For example, if a 

measure relates to receipt of a specific service, the 

denominator may need to be adjusted to reflect instances in 

which the patient refuses the service or the service is 

contraindicated. 100.0% 





Systems or methods used by the MCHP/PIHP to estimate 
populations when they cannot be accurately or completely 


10.10 counted (e.g., newborns) are valid.* NA NA NA NA NA 0 0 0 0 NA 
Number Met 7 7 7 7 7 35 (1) (1) 35 100.0% 
Number Partially Met 0 0 0 10) 10) 
Number Not Met 0 10) 10) 1) 0) 
Number Applicable 7 7 7 7 7 


Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met; O=Not Met, validated through HEDIS 
software certification process, but no proper explanation of the processin documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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When determining the denominator, it wasexpected that all MO HealthNet Managed 
Care health plans would identify smilar percentages of their total population as eligible 
forthis measure. The identification of eligible members for the HEDIS 2007 Annual 
Dental Visit measure is dependent on the quality of the enrollment and eligibility files. 
The rate of eligible members (eligible population identified / total MO HealthNet 
enrollment) was calculated forall health plans and is illustrated in Figure 1. Two-tailed z 
tests of each health plan were conducted comparing the health plansto the rate of 
eligible members forall MO HealthNet Managed Care health plansat the 95% level of 
confidence. The percentage of eligible members identified by Mercy CarePlus 
(29.79%) showed a statistically significant difference (e.g. statistic ally lower rate) when 
compared to the group average. This difference in rates may be due to the 
demographic characteristics of the member population, the completeness of claims 


data, orthe processes of identifying eligible members. 


Figure 1 - MO HealthNet Managed Care Program HEDIS 2007 Annual Dental Visit, Bigible Members 


CMFHP 


= 2007 53.64% 58.38% 59.08% 29.79% 53.06% 51.54% 





Note: Erorbarson the y-axis represent 95% confidence intervals; * indicates values are significantly loweror 
higher than the MOHealthNet average at the 95% level of significance. Enrollment as of the last week in 
December 2006 (the measurement year) was used to calculate the rate. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Too! (DST); Missouri Department of Social 
Services, Division of Medical Services, State MPRI Session Screens, enrollment figures for all Waivers, 
December 31, 2006. 
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Processes Used to Produce Numerators 

The objectives of this activity were to evaluate the MO HealthNet Managed Care 
health plans’ ability to accurately identify medical events, evaluate the ability to 
identify events from other sources, evaluate procedures for non-duplicate counting 
of multiple events, review time parameters and the use of non-standard code maps, 
and assess the processes and procedures forcollecting and incomorating medical 
record review data. The Technical Specifications for the HEDIS 2007 Annual Dental 
Visit measure required the measure be calculated using the Administrative Method; 


the Hybrid Method proceduresdo not apply. 


Table 15 showsthe numerators, denominators, rates, and confidence intervals 
submitted by the MO HealthNet Managed Care health plansto the SPHA on the DST 
forthe HEDIS 2007 Annual Dental Visit measure. The rate forall health plans was 
calculated by the EQRO; therefore, no confidence interval isreported forthe 
statewide rate. HealthCare USA reported rates for each of the three regions 
(Eastem, Central, and Westem) separately to the SPHA; asit is the task of the EQRO 
to compare MCO to MCO, these numbers have been combined to show an overall 
MCO rate. Therefore, there isno confidence interval to report, because the MCO 


reported confidence intervals for each region and notasa plan on the DST. 


J ust asin 2005, the last EQR year when this measure was audited, all MO HealthNet 
Managed Care health plans reported individual rates lower than the National 
Medicaid Average (42.5%) and the combined rate forall health plans was lower 
than that average aswell. However, the rate forall MO HealthNet Managed Care 
health plans was 32.50% in 2007 and only 29.76% in 2005, thereby showing an 
increase in access to dental visits within the MO HealthNet Managed Care 
population. The 2007 health plan rates ranged from 27.76% (Missoun Care) to 37.49% 
(Children’s Mercy Family Health Partners) (see Table 15 and Figure 2). Missour Care 
reported a significantly lowerrate than the average combined rate forall MO 
HealthNet Managed Care health plans; the rate reported by Children’s Mercy 


Family Health Partners was significantly higher than the average. 
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Table 15 - Data Submission and Final Validation for HEDIS 2007 Annual Dental 


Number 

Administrative } Administrative | 

Eligible | Hits Reported by | Rate Reported by | | Hits Validated by | Validated by| Estimated 

MO HealthNet Health Plan Population MCHP (DST) MCHP (DST) | LCL- UCL(DST) | io} ,{o} =o} ;{e) 











Visit (combined rate) 





Rate 


Blue Advantage Plus 14,138, 4,768 33.72% —-32.94-34.51% 33.68% 
Childrens Mercy Family Health Partners 23,806 8,926 37.49% 36.88-38.11% 37.44% 


HealthCare USA 88,406 28,493 32.23% 32.18% | 

Mercy CarePlus 20,617 6,278 30.45% 29.82-31.08% 30.43% 

Missouri Care 14,945 4,149 27.76% 27.04-28.48% 27.68% 0.08% 
All MO HealthNet MCHPs 161,912 0.05% 


Note: DST =Data Submission Tool; NA =Not Applicable; EQRO =Extemal Quality Review Organization 
(Behavioral Health Concepts, Inc.); LCL =95% Lower Confidence Limit; UCL =95% Upper Confidence 
Limit. Rate Validated by EQRO =Adnmiinistrative Hits Validated by EQEO / Eligible Population. Estimated 
Bias =Rate Reported by MCHP (DST) - Rate Validated by EQRO. Postive biasindicatesan 
overestimate. 

Source: MO HealthNet Managed Care Health Plans’ HEDIS 2007 Data Submission Tools (DST). 


Figure 2 - MO HealthNet Managed Care Program HEDIS 2007 Annual Dental Visit, Administrative Rates 





National Medicaid Average = 42.5% 
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m Reported Admin Rate 33.72% 37.49% 32.23% 30.45% 27.76% 32.50% 








Note: Erorbarson the y-axis represent 95% confidence intervals, * indicates values are significantly 
lowerorhigherthan the MOHealthNet average at the 95%level of significance. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); National Committee for Quality 
Assurance (NCQA). 
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Table 16 shows the validation of numerators based on the review of numerator 
extract filesand the medical record review. Item 13.2 wasnot applicable to this 
measure, asthe services reported could not easily be obtained outside the health 
plan. Item 13.6 also did not apply, asnone of the MO HealthNet Managed Care 
health plans used non-standard codesto determine the numerators. Items 13.8 
through 13.13 relate to the Hybrid Method and were not applicable forthe Annual 
Dental Visit measure. Acrossall MO HealthNet Managed Care health plans, 100% of 


the criteria forcalculating the numerator were met. 
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Table 16 - Numerator Validation Findings, HEDIS 2007 Annual Dental Visit Measure 





MO HealthNet MCHP All MO HealthNet MCHPs 


Partially Number Number 
Audit Elements Met Not Met Applicable 


The MCHP/PIHP has used the appropriate data, including 
linked data from separate data sets, to identify the entire at- 
BA risk population. 2 2 2 2 2 5 () () 5 100.0% 
The MCHP/PIHP has in place and utilizes procedures to 
capture data for those performance indicators that could be 
easily under-reported due to the availability of services 
23.2 outside the MCHP/PIHP. NA NA NA NA NA fo) fe) fo) fo) NA 
The MCHP's/PIHP's use of codes used to identify medical 
events are complete, accurate, and specific in correctly 
B3 describing what has transpired and when. 2 2 a 2 2 5 fe} i) 5 400.0% 


when classifying members for inclusion or exclusion in the 
BA numerator. 2 2 2 2 és 5 0 oO 5 100.0% 


The MCHP/PIHP has avoided or eliminated all double- 
B5 counted members or numerator events. 2 2 2 2 2 5 0 oO 5 100.0% 


Any non-standard codes used in determining the numerator 
have been mapped to a standard coding scheme in a manner 
that is consistent, complete, and reproducible as evidenced 
by areview of the programming logic or ademonstration of 
B6 the program. NA NA NA NA NA to} io} (0) to} NA 
Anytime parameters required by the specifications of the 
performance measure are adhered to (i.e., that the measured 
event occurred during the time period specified or defined in 
B.7 the performance measure). 2 2 2 2 2 5 fe) 0 5 100.0% 


Medical record reviews and abstractions have been carried 
out ina manner that facilitates the collection of complete, 


B8 accurate, and valid data. NA NA NA NA NA (e} (e} {0} {0} NA 
Record review staff have been properly trained and 

Bo supervised for the task. NA NA NA NA NA O ie} Oo Oo NA 
Record abstraction tools require the appropriate notation 

13.10 that the measured event occurred. NA NA NA NA NA {0} (o} 0 0 NA 
Record abstraction tools require notation of the results or 

B11. findings of the measured event (if applicable). NA NA NA NA NA ie) f¢) ie) {0} NA 


Data included in the record extract files are consistent with 
data found in the medical records as evidenced by a review of 
asample of medical record for applicable performance 
measures. (From M edical Record Review Validation Tools- 
B.2 Table 5, ATTACHMENT XiIl) NA NA NA NA NA (0) 0 oO 10) NA 


The process of integrating administrative data and medical 
record data for the purpose of determining the numerator is 





B.B consistent and valid. NA NA NA NA NA 0 Oo ie} 10) NA 
Number Met 5 5 5 5 5 25 0 0 25 100.0% 
Number Partially M et fe) 0 (e} oO 10) 
Number Not Met oO ie} te) 0 oO 
Number Applicable 5 5 5 5 5 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 





Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met ; O =Not Met, validated through HEDIS 
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Measures 


software certification process, but no proper explanation of the process in documentation orno or insufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Submission of Measures to the State 

Reports from the SPHA were obtained regarding the submission of the HEDIS 2007 
Annual Dental Visit measure. All five MO HealthNet Managed Care health plans 
calculated and submitted the measure to the SPHA and SMA. All health plansin the 
State of Missouri are required to calculate and report the measure to the SPHA, and 
MO HealthNet Managed Care health plansare required to report the measure to 
the SMA. 


Final Validation Findings 

Table 15 shows the final data validation findings and the total estimated bias 
calculation based on the validation and review of the MO HealthNet Managed 
Care health plans’ extract files for calculating the HEDIS 2007 Annual Dental Visit 
measure. Figure 3 illustrates the differences between the rates reported to the SPHA 
and those calculated by the EQRO for Annual Dental Visit calculations. The 

EQRO was 32.44%, while the rate reported by MO HealthNet Managed Care health 


plans was 32.50%, a 0.06% overestimate. 


Figure 3 - Rates Reported by MO HealthNet MC HPs and Validated by EQRO, HEDIS 2007 Annual Dental 
Visit Measure 
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@ Reported Admin Rate 33.72% 37.49% 32.23% 30.45% 27.76% 32.50% 
DEORO Validated Rate 33.68% 37.44% 32.18% 30.43% 27.68% 32.44% 











Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); BHC, Inc. 2007 Extemal Quality 
Review Performance Measure Validation. 
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HEDIS 2007 ADOLESCENT WELL-CARE VISITS 


Data Integration and Contol 

The objective of this activity wasto assess the MO HealthNet Managed Care health 
plans’ ability to link data from multiple sources forthe calculation of the HEDIS 2007 
Adolescent Well-Care Visits measure. It isrelated to the integrity of the 
management information systems and the ability to ensure accuracy of the 
measures. For the HEDIS 2007 Adolescent Well-Care Visits measure, the sources of 
data included enrollment, eligibility, and claim files. Table 17 summarizes the 
findings of Attachment V (Data Integration and Control Findings) of the CMS 
Protocol. The rate of itemsthat were Met wascalculated acrossMO HealthNet 
Managed Care health plansand from the number of applicable itemsfor each 


health plan. 


No data integration and control issues were discovered by the EQRO. AllMO 
HealthNet Managed Care health plans (100.0%) met the criteria forall areasof data 


integration and control. 
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Table 17 - Data Integration and Control Findings, HEDIS 2007 Adolescent Well-Care Visits 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Number 
Item Audit Elements BA+ Partially Met Met Applicable Rate Met 


MCHP/PIHP processes accurately and completely transfer 
data from the transaction files (e.g., membership, provider, 
encounter/claims) into the repository used to keep the data 
until the calculations of the performance measures have been 


5.1 completed and validated. 2 2 2 2 2 5 0 0 5 100.0% 
5.2 Samples of data from repository are complete and accurate. 2 2 2 2 2 3 10) 10) 5] 100.0% 


MCHP’s/PIHP’s processes to consolidate diversified files, and 
to extract required information from the performance 
5.3 measure repository are appropriate. 2 2 2 ps 2 5 0 Co) 5 100.0% 
Actual results of file consolidations or extracts were 
consistent with those which should have resulted according to 
5.4 documented algorithms or specifications. A 2 2 2 2 5 0 0 5 100.0% 


Procedures for coordinating the activities of multiple 
subcontractors ensure the accurate, timely, and complete 
5.5 integration of data into the performance measure database. 2 2 2 ] 2 5 0 0 5 100.0% 


Computer program reports or documentation reflect vendor 
coordination activities, and no data necessary to performance 
measure reporting are lost or inappropriately modified during 


5.6 transfer. 2 2 2 2 2 5 0 0 5 100.0% 
The repository’s design, program flow charts, and source 
5.7 codes enable analyses and reports. 2 2 Dp: 2 2 5 (0) 0 5 100.0% 


Proper linkage mechanisms have been employed to join data 
from all necessary sources (e.g., identifying a member with a 
5.8 given disease/condition). A 2) A) 2 2 5 0 0 5 100.0% 
Examine and assess tne agequacy or tne aocumentation 
governing the production process, including MCHP/PIHP. 
production activity logs, and MCHP/PIHP staff review of 
5.9 report runs. 2 2 2 2 2 5 10) 10) 5 100.0% 


5.10 Prescribed data cutoff dates were followed. A 2 2 D 2 5 0 0 5 100.0% 


The MCHP/PIHP has retained copies of files or databases used 
for performance measure reporting, in the event that results 
5.11 need to be reproduced. 2 2 2 2 2 5 0 0 5 100.0% 
Review documentation standards to determine the extent to 
which the reporting software program is properly 
documented with respect to every aspect of the performance 
measurement reporting repository, including building, 
5.12 maintaining, managing, testing, and report production. 2 2 2 2 2 5 10) 10) 5 100.0% 
Review the MCHP’s/PIHP’s processes and documentation to 


determine the extent to which they comply with the 
MCHP/PIHP standards associated with reporting program 


5.13 specifications, code review, and testing. 2 > 2 2 2 5 (0) 0 5 100.0% 
Number Met 13 13 13 13 13 65 ) () 65 100.0% 
Number Partially Met 0 0 fe) fe) 
Number Not Met (0) (0) 0 ie) 
Number Applicable 13 13 13 13 13 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met ; O =Not Met, validated through HEDIS 
software certification process, but no proper explanation of the process in documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 
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Documentation of Data and Processes 

The objectives of this activity were to assess the documentation of data collection; the 
process of integrating data into a performance measure set; the procedures used to 
query the data set forsampling, numerators and denominators; and the ability to apply 
proper algorithms forthe calculation of HEDIS 2007 Adolescent Well-Care Visits 
measure. Table 18 summarizes the findings of Attachment VI (Data and Processes Used 
to Calculate and Report Performance Measures) of the CMS Protocol. Item 7.2 did not 
apply to any MO HealthNet Managed Care health plans for this measure, as none of 
the MCOsused non-standard codes. Items 7.3 (statistical testing of results and 
corrections made after processing), 7.4 (inclusion of extemal data sources), and 7.9 
(consistent data from measure to measure) did not apply to thismeasure. Items 7.5, 
7.7,and 7.10 are only applicable forthe Hybrid method of calculation, and therefore 
did not apply to Blue-Advantage Plus of Kansas City, HealthCare USA, or Mercy 
CarePlus. Each MO HealthNet Managed Care health plan calculating the measure 
Met 100.0% of the criteria for processes used to calculate and report the HEDIS 2007 
Adolescent Well-C are Visits measure. 
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Table 18 - Data and Processes Used to Calculate and Report Performance Measures, HEDIS 2007 Adolesc ent Well-Care Visits Measure 


| MO HealthNet MCHP All MO HealthNet MCHPs 








| 

| 
| Number Number Not Number 

Item Audit Elements BA+ CMFHP HCUSA MCP MOCare | Number Met} Partially Met Met Applicable Rate Met 


Statistical testing of results and any corrections or 
adjustments made after processing. 


a 100.0% 


If sampling used, description of sampling techniques, and 
documentation that assures the reviewer that samples used 
for baseline and repeat measurements of the performance 
measures were chosen using the same sampling frame and 
methodology. NA 2 NA 2 2 2 100.0% 
Pads | be et ee 100.0% 


oh a ee oe 
Number Not Met 
er ee ee, (a a Ee ee ee 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or properexplanation in documentation. 1 =Partially Met; O =Not Met, validated through HEDIS 
software certification process, but no proper explanation of the processin documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 

Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 















Detailed medical record review methods and practices, 
including the qualifications of medical record review 
supervisor and staff; reviewer training materials; audit tools 
used, including completed copies of each record-level 
reviewer determination; all case-level critical performance 
measure data elements used to determine a positive or 
negative event or exclude a case from same; and inter-rater 
reliability testing procedures and results. 






























Data that are related from measure to measure are 
consistent (e.g., membership counts, provider totals, number 
of pregnancies and births). 







When determining improvement in performance between 
measurement periods, appropriate statistical methodology is 
applied to determine levels of significance of changes. 
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Processes Used to Produce Denominators 

The objective of this activity wasto determine the extent to which all eligible 
members were included in the denominator, evaluate the programming and logic 
source codes, and evaluate the specifications foreach measure. Forthe HEDIS 
2007 Adolescent Well-Care Visits measure, the sources of data include enrollment, 
eligibility, and claim files. Table 19 summarizes the findings of Attachment X 
(Denominator Validation Findings) of the CMS Protocol. Items 10.5 (identification of 
gender of the member), 10.6 (calculation of member months or years), and 10.10 
(Systems for estimating populations when they are unable to accurately be 
counted) were not applicable to the HEDIS 2007 Adolesc ent Well-C are Visits 
measure. Allofthe remaining criteria were Met by all of the MO HealthNet 
Managed Care health plans; 100.0% of the criteria were Met forthe processes used 


to produce denominators. 
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Table 19 - Denominator Validation Findings, HEDIS 2007 Adolesc ent Well-Care Visits Measure 


MO HealthNet MCHP All | Mo ) HealthNet MCHPs 


iE Number | Number Not Number 
Audit Elements Sete | IE csr pom pemher Met | parally, Moe) bee Met eepplicable)| Rate Met 


All members who were eligible to receive the specified services 
were included in the initial population from which the final 
denominator was produced. This "at risk" population included 
both members who received the services, as well as those who 
did not. This same standard applies to provider groups or other 
relevant populations identified in the specifications of each 
performance measure. 100.0% 


‘alculations of continuous enrollment criteria were correctly 
10.3 carried out and applied to each measure (if applicable). 2 2 2 2 5 100.0% 


The MCHP/PIHP can identify the variable(s) that define the 

member's sex in every file or algorithm needed to calculate the 

performance measure denominator, and the MCHP/PIHP can 

explain what classification is carried out if neither of the 

required codes is present. NA NA 

The MCHP/PIHP has properly evaluated the completeness and 

accuracy of any codes used to identify medical events, such as 

diagnoses, procedures, or prescriptions, and these codes have 

been appropriately identified and applied as specified in each 

performance measure. 2 5 


members from a denominator were followed. For example, if a 

measure relates to receipt of a specific service, the 

denominator may need to be adjusted to reflect instances in 

which the patient refuses the service or the service is 

contraindicated. 2 2 2. 2 


umber Partai Met 
umber Wott fo 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was 
used by the MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Met and validated through HEDIS software certification process 
and proper explanation in documentation or proper explanation in documentation. 1 =Partially Met ; 0 =Not Met, validated through HEDIS 
software certification process, but no proper explanation of the processin documentation orno orinsufficient explanation in documentation. * 
Item isnot applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 

Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Figure 4 illustrates the rate of eligible members identified by each MO HealthNet 
Managed Care health plan, based on the enrollment of all MO HealthNet 
Managed Care membersasof December 31, 2006 (the end of the CY2006 
measurement year). Itwasexpected that MO HealthNet Managed Care health 
plans would identify similar proportions of eligible members for the HEDIS 2007 
Adolescent Well-Care Visits measure. The rate of eligible members (percent of 
eligible members divided by the total enrollment) wascalculated forall MO 
HealthNet Managed Care health plansand two-tailed z-tests of each health plan 
compared to the state rate of eligible members were conducted at the 95% level of 
confidence. Children’s Mercy Family Health Partners (1.01%) and MO Care (1.53%) 
identified rates that were significantly lower than the MO HealthNet Managed Care 
health plan average (15.18%). The percentage of eligible members identified by 
Healthcare USA (22.56%) was significantly higher than the MO HealthNet Managed 


Care average. 


Figure 4 - MO HealthNet Managed Care Program HEDIS 2007 Adolesc ent Well-Care Visits, Bigible 
Members 






































30.00% 
*- 
25.00% 
20.00% 
15.00% 
g 
e 
10.00% 
ry 
5.00% kad 
0.00% + =n 
5.00% 
All MO 
BAt CMFHP HCUSA MCP MOCare HealthNet 
MCHPs 
2007 17.50% 1.01% 22.56% 12.24% 1.53% 15.18% 











Note: Erorbarson the y-axis represent 95% confidence intervals, * indicates values are significantly 
lower orhigherthan the MOHealthNet average at the 95%level of significance. Enrollment as of the 
last week in December 2006 (the measurement year) was used to calculate the rate. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Too! (DST); Missouri Department of Social 
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Services, Division of Medical Services, State MPRI Session Screens, enrollment figures for all Waivers, 
December 31, 2006. 
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Processes Used to Produce Numerators 

The objectives of this activity were to evaluate the MO HealthNet Managed Care 
health plans’ ability to accurately identify medical events, evaluate the ability to 
identify events from other sources, evaluate procedures for non-duplicate counting 
of multiple events, review time parameters and the use of non-standard code maps, 
and assess the processesand procedures forcollecting and incomorating medical 
record review data. Forthe HEDIS 2007 Adolescent Well-Care Visits measure, the 
sources of data included enrollment, eligibility, and claim files. Table 20 showsthe 
numerators, denominators, rates, and confidence intervals submitted by the MO 
HealthNet Managed Care health plansto the SPHA on the DST. The “combined” 
rate for HealthCare USA wascalculated by the EQRO based on reported rates for 
each region (Central, Eastem, and Westem); thus, there isno confidence interval to 
report. The EQRO also calculated the rate forall MO HealthNet Managed Care 
health plans; this statewide rate also doesnot have a confidence interval reported. 
The rate forall MO HealthNet Managed Care health plans was 34.81%, with health 
plan rates ranging from 29.49% (Mercy CarePlus) to 44.91% (Missouri Care). 
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Table 20 - Data Submission for HEDIS Adolescent Well-Care Visits Measure 





Rate 
Final Data Administrative Hybrid Hits Total Hits |Reported by 
Collection Denominator | Hits Reported by | Reported by | Reported by MCHP LCL - UCL 
MO HealthNet MCHP Method Used (> 9) MCHP ysl Wee | MCHP Heche MCHP Lbclal ae We] Pee) (DST) 
= © 


2 ——E——— 


30.20% - 
Blue Advantage Plus Administrative 4,613 1,455 1,455 31.54% 32.88% 


40.10% - 
Missouri Care Hybrid 44.91% 49.71% 


All MO HealthNet MCHPs 47,688 16,523 16,602 34.81% 


Note: DST =Data Submission Tool; NA =Not Applicable; EQRO =Extemal Quality Review Organization (Behavioral Health Concepts, Inc.); LCL= 
95% Lower Confidence Limit; UCL =95% Upper Confidence Limit. The statewide rate forall MO HealthNet MCHPs wascalculated by the EQRO 
using the sum of numerators divided by sum of denominators. There wasno statewide rate or confidence limits reported to the SMA or SPHA. 
Source: MO HealthNet Managed Care Organization HEDIS 2007 Data Submission Tools (DST) 
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Figure 5, Figure 6, and Figure 7 illustrate the rates reported by the MO HealthNet 
Managed Care health plansand the rates of administrative and hybrid hits foreach 
MO HealthNet Managed Care health plan. The rate reported by each health plan 
wascompared with the rate forall MO HealthNet Managed Care health plans. 
Two-tailed z-tests of each MO HealthNet Managed Care health plan comparing 
MO HealthNet Managed Care health plansto the rate forall MO HealthNet 
Managed Care health plans were calculated at the 95% confidence interval. J ust 
asfound during the 2004 EQR, the last time this measure was audited, the rate forall 
health plans (30.13%) was lower than both the National Medicaid rate (43.6%) and 
the National Commercial Rate (40.3%). However, the 2007 rate forall health plans 
(34.81%) is significantly higherthan the 2004 rate forall health plans (30.13%), 
thereby showing an increased level of Adolescent Well-Care Visits being delivered 
throughout regions. The rates for Children’s Mercy Family Health Partners (42.82%) 
and Missoun Care (44.91%) were significantly higher than the average. Both of these 
rates (CMFHP and MOCare) were also higherthan the National Commercial Rate, 
but only Missoun Care reported a rate higher than the National Medicaid Rate. In 
2004, Missouri Care also reported a rate higher than both the National Medicaid 
Rate and National Commercial Rate. Blue-Advantage Plus of Kansas City and 
Mercy CarePlus reported rates (31.54% and 29.49%, respectively) that were 
significantly lowerthan the statewide rate forall MO HealthNet Managed Care 


health plans. 
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Figure 5 - MO HealthNet Managed Care Program HEDIS 2007 Adolesc ent Well-Care Visits, Rates 
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mReportedTotalRate 31.54% 42.82% 36.37% 29.49% 44.91% 34.81% 





Note: Erorbarson the y-axis represent 95% confidence intervals; * indicates values are significantly 
lowerorhigherthan the MOHealthNet average at the 95%level of significance. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); National Committee for Quality 
Assurance (NCQA). 


When the rate of administrative and hybrid hits was examined separately, there did 
not appearto be a great deal of variability among MO HealthNet Managed Care 
health plans from the administrative rate forall MO HealthNet Managed Care 
health plans (34.65%). Rates ranged from 29.49% (Merc y CarePlus) to 36.57% 
(Missour Care). Statistically, the rate reported by Mercy CarePlus was signific antly 
lowerthan the statewide rate forall health plans; the rates for Healthcare USA and 


Missoun Care were significantly higherthan the average rate. 
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Figure 6 - MO HealthNet Managed Care Program HEDIS 2007 Adolesc ent Well-Care Visits, 
Administrative Rate Only 
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Note: Erorbarson the y-axis represent 95% confidence intervals; * indicates values are significantly 
lowerorhigherthan the MOHealthNet average at the 95%level of significance. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); National Committee for Quality 
Assurance (NCQA). 
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Only two of the five MO HealthNet Managed Care health planscalculated the 
Adolescent Well-Care Visits measure hybridly. There were no statistic ally significant 


differences found in these rates. 


Figure 7 - MO HealthNet Managed Care Program HEDIS 2007 Adolesc ent Well-Care Visits, Hybrid Rate 
Only 
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m Reported Hybrid Rate 10.46% 8.33% 9.37% 











Note: Erorbarson the y-axis represent 95% confidence intervals 
Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); National Committee for Quality 
Assurance (NCQA) 
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Table 2land Table 22 summarize the findings of the EQRO medical record review 
validation and Attachment XIl (Impact of Medical Record Findings) of the CMS 
Protocol. Two of the MO HealthNet Managed Care health plans (Children’s Mercy 
Family Health Partners and Missouri Care) used the Hybrid Method of calculation. 
Children’s Mercy Family Health Partners selected a sample of 411 eligible members, 
consistent with HEDIS technical specifications. Missoun Care selected a sample of 
432 eligible members, asdetermined by the number of eligible members and in 
accordance with HEDIS technical specifications. A total of 60 of the 79 reported 
medical record hybrid hitsby MO HealthNet Managed Car health plans were 
sampled for validation by the EQRO. Of the records requested, all 60 were received 
forreview. The EQRO wasable to validate 59 of the 60 records received, an Error 
Rate of 1.7% acrossall MO HealthNet Managed Care health plans. The number of 
False Positive Records (the total amount that could not be validated) was 1 of the 
79 reported hits. The estimated bias for individual MO HealthNet Managed Care 
health plans based on the medical record validation ranged from a 0.0%to 0.3% 
overestimate in the rate, with an average overestimate of 0.2% for all health plans. 


Table 22 shows the impact of the medical record review findings. 
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Table 21 - Medical Record Validation for HEDIS 2007 Adolesc ent Well-Care Visits Measure 


Numerator Medical Number 
Hits by Records Number Medical Medical Rate 
Medical Sampled for Records Records Validated of 
Denominator Records Audit by Received for Validated by Records Accuracy 
MO HealthNet MCHP (Sample Size) (DST) io} >{e) Audit by EQRO ie} >{e) Received Rate 


Childrens Mercy Family Health Partners 96.7% 96.7% 
Missouri Care 100.0% 100.0% 


All MO HealthNet MCHPs 


Note: DST=Data Submission Tool; EQRO =Extemal Quality Review Organization (Behavioral Health Concepts, Inc.); Accuracy Rate =Number of Medical Records 
Validated by the EQRO/Number of Records Selected for Audit by EQRO; Enor Rate =100%- Accuracy Rate; Weight of Each Medical Record =100%/ 
Denominator (Sample Size); False Positive Records =Eror Rate * Numerator Hits Reported by MCHP (DST); Estimated Bias from Medical Records =Percent of bias 
due to the medical record review =False Positive Rate * Weight of Each Medical Record. 

Source: MO HealthNet MCHP Data Submission Tools (DST); BHC, Inc. 2007 Extemal Quality Review Performance Measures Validation. 





Table 22 - Impact of Medical Record Findings, HEDIS 2007 Adolesc ent Well-Care Visits Measure 






MO HealthNet MCHP 


Audit Elements aS) A Be ee Eee 


12.1 Final Data Collection Method Used (e.g., MRR, hybrid, ) Administrative Hybrid Administrative Administrative Hybrid 
















Error Rate (Percentage of records selected for audit that were 
12.9 identified as not meeting numerator requirements) NA 2.33% NA NA 0.00% 


13°3 Is error rate < 10%? (Yes or No) NA Yes NA NA Yes 
If yes, MCHP/PIHP passes MRR validation; no further MRR 


calculations are necessary. NA Passes NA NA Passes 
If no, the rest of the spreadsheet will be completed to determine 
the impact on the final rate. NA NA NA NA NA 


Denominator (The total number of members identified for the 
12.4 denominator of this measure, as identified by the MCHP/PIHP) 5541 411 33762 8470 432 


Weight of Each Medical Record (Impact of each medical record on the 

12.5 final overall rate; determined by dividing 100% by the denominator) NA NA NA NA NA 
Total Number of MRR Numerator Positives identified by the MCHP/PIHP 

12.6 using MRR. NA NA NA NA NA 


Expected Number of False Positives (Estimated number of medical 
12.7 records inappropriately counted as numerator positives) NA NA NA NA NA 


Estimated Bias in Final Rate (The amount of bias caused by medical 
record review) 





Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the Health Plan; Administrative Method was used by the Health Plan and 
the item relatesto the Hybrid Method; 2 =Metand validated through HEDIS software certification processand proper explanation in documentation or proper 
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explanation in documentation. 1 =Partially Met; O =Not Met, validated through HEDIS software certification process, but no proper explanation of the processin 
documentation or no orinsufficient explanation in documentation. 
Source: BHC, Inc. 2006 Extemal Quality Review Performance Measure Validation. 
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Table 23 shows the validation of numerators based on the review of numerator 
extract filesand the medical record review. Item 13.2 doesnot apply to this 
measure asis it unlikely members would receive Well-Care Visit services outside the 
health plan. Item 13.6 did not apply to any of the MO HealthNet Managed Care 
health plans, asnone of the health plansused non-standard codes. Items 13.8 
through 13.13 relate to the Hybrid Method and were not applicable to Blue- 
Advantage Plus of Kansas City, HealthCare USA, or Mercy CarePlus. AcrossMO 
HealthNet Managed Care health plans, 100% of the criteria forcalculating 
numerators were met. All five (100%) of the health plans Met the criteria for using 
the appropnate data to identify the at-risk population, using complete medical 
event codes, correctly classifying members for inclusion in the numerator, 
eliminating or avoiding double-counting members, and following applicable time 
parameters. Two of the five health plans calculated this measure using the Hybrid 
Method (Missoun Care and Children’s Mercy Family Health Partners). Both Met all 
criteria (100.0%) relating to medical record reviewsand data. The MO HealthNet 
Managed Care health plans Met 100.0% of criteria forcalculating the numerator for 
the HEDIS 2007 Adolescent Well-Care measure. 


Cs: igasguanetn Performance Management Solutions Group 
=a A division of Behavioral Health Concepts, Inc. 152 


MO HealthNet Managed Care Extemal Quality Review Section 3 


Report of Findings - 2007 Validation of Performance Measures 


Table 23 - Numerator Validation Findings, HEDIS 2007 Adolesc ent Well-Care Visits Measure 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Number 
Audit Elements BA+ Partially Met Met Applicable Rate Met 


The MCHP/PIHP has used the appropriate data, including 
linked data from separate data sets, to identify the entire 
at-risk population. 





The MCHP/PIHP has in place and utilizes procedures to 
capture data for those performance indicators that could be 
easily under-reported due to the availability of services 
outside the MCHP/PIHP. 


The MCHP's/PIHP's use of codes used to identify medical 
events are complete, accurate, and specific in correctly 
describing what has transpired and when. 100.0% 


The MCHP/PIHP correctly evaluated medical event codes 
when classifying members for inclusion or exclusion in the 
numerator. 100.0% 


The MCHP/PIHP has avoided or eliminated all double- 
counted members or numerator events. 100.0% 


Any non-standard codes used in determining the numerator 
have been mapped to a standard coding scheme in a 
manner that is consistent, complete, and reproducible as 
evidenced by a review of the programming logic or a 


demonstration of the program. 


Any time parameters required by the specifications of the 
performance measure are adhered to (i.e., that the 
measured event occurred during the time period specified 
or defined in the performance measure). 


Medical record reviews and abstractions have been carried 
out in a manner that facilitates the collection of complete, 
accurate, and valid data. 


Record review staff have been properly trained and 
supervised for the task. 


Record abstraction tools require the appropriate notation 
that the measured event occurred. 


Record abstraction tools require notation of the results or 
findings of the measured event (if applicable). 


Data included in the record extract files are consistent with 
data found in the medical records as evidenced by a review 
of a sample of medical record for applicable performance 
measures. (From Medical Record Review Validation Tools) 


The process of integrating administrative data and medical 
record data for the purpose of determining the numerator 


is consistent and valid. 100.0% 
Number Met 5 11 5 5 11 37 o oO EVA 100.0% 
Number Partially Met (0) 0 (0) ie} 10) 

Number Not Met 0 0 0 (0) 0 

Number Applicable 5 11. 5 5 11 

Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 





Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method wasused by 
the MO HealthNet MCHP and the item relatesto the Hybrid Method; 2 =Met and validated through HEDIS software certification processand proper 
explanation in documentation or proper explanation in documentation. 1 =Partially Met ; O =Not Met, validated through HEDIS software 

certification process, but no proper explanation of the process in documentation or no or insufficient explanation in documentation. * Item isnot 
applicable to the measure being validated. Rate Met =Number Met/ NumberApplicable. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Sampling Procedures for Hybrid Method 

The objectives of this activity were to evaluate the MO HealthNet Managed Care 
health plans’ ability to randomly sample from the eligible members forthe measure 
when using the Hybrid Method of calculation. Table 24 summarizes the findings of 
Attachment XV (Sampling Validation Findings) of the CMS Protocol. Items 15.3 
(each providerhad an equal chance of being sampled) and 15.9 (documenting if 
the requested sample size exceeded the eligible population size) did not apply to 
any of the MO HealthNet Managed Care health plans for this measure; and none of 
the items were applicable to Blue-Advantage Plus of Kansas City, HealthCare USA, 
or Mercy CarePlus. Acrossall MO HealthNet Managed Care health plans, the 
criteria forsampling were Met 100.0% of the time. The health plans using the Hybrid 
Method of calculating the HEDIS 2007 Adolescent Well-Care Visits measure Met 


100.0% of the criteria for propersampling. 
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Table 24 - Sampling Validation Findings, HEDIS 2007 Adolesc ent Well-Care Visits Measure 


MO HealthNet MCHP 





All MO HealthNet MCHPs 





15.1 


wey 72 


15.3 


15.4 


15.5 


15.6 


15.7 


15.8 


15.9 


T5710) 


15.11 


15,12 





Audit Elements 
Each relevant member or provider had an equal chance of 
being selected; no one was systematically excluded from 
the sampling. 
The MCHP / PIHP followed the specitications set forth in 
the performance measure regarding the treatment of 
sample exclusions and replacements, and if any activity 
took place involving replacements of or exclusions from 
the sample, the MCHP/PIHP kept adequate documentation 
of that activity. 


Each provider serving a given number of enrollees had the 
same probability of being selected as any other provider 
serving the same number of enrollees. 


any bias was detected, the MCHP/PIHP is able to provide 
documentation that describes any efforts taken to correct 
it. 

Ihe sampling methodology employed treated all measures 
independently, and there is no correlation between drawn 
samples. 


Relevant members or providers who were not included in 
the sample for the baseline measurement had the same 

chance of being selected for the follow-up measurement 

as providers who were included in the baseline. 


The MCHP/PIHP has policies and procedures to maintain 
files from which the samples are drawn in order to keep 
the population intact in the event that a sample must be 
re-drawn, or replacements made, and documentation that 
the original population is intact. 


Sample sizes meet the requirements of the pertormance 
measure specifications. 


The MCHP/PIHP has appropriately handled the 
documentation and reporting of the measure if the 
requested sample size exceeds the population size. 


The MCHP/PIHP properly oversampled in order to 
accommodate potential exclusions 


Substitution applied only to those members who met the 
exclusion criteria specified in the performance measure 
definitions or requirements. 


and the percentage of substituted records was 
documented. 


Number Met 
Number Partially Met 
Number Not Met 
Number Applicable 
Rate Met 


Number Number Not Number 
BA+ HCUSA Partially Met Met mV) li te-]o)(-) Rate Met 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 


2 100.0% 
20 100.0% 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was used by 
the MO HealthNet MCHP and the item relatesto the Hybrid Method; 2 =Met and validated through HEDIS software certification processand proper 
explanation in documentation or proper explanation in documentation. 1 =Partially Met; O =Not Met, validated through HED!S software certification 
process, but no properexplanation of the process in documentation orno or insufficient explanation in documentation. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 
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Submission of Measures to the State 

Reports from the SPHA were obtained regarding the submission of the HEDIS 2007 
Adolescent Well-Care Visits measure. All MO HealthNet Managed Care health 
plans reported the measure to the SPHA and SMA. 


Final Validation Findings 

Table 25 shows the final data validation findings for the calculation of the HEDIS 2007 
Adolescent Well-Care Visits measure and the total estimated biasin calculation 
based on the validation of medical record data and review of the MO HealthNet 
Managed Care health plan extract files. Figure 8 illustrates the differences between 
the rates reported to the SPHA and those calculated by the EQRO. The rate forall 
MO HealthNet Managed Care health planscalculated based on data validated by 
the EQRO was 34.94%, while the rate reported by all health plans was 34.81%, a 


0.13% underestimate. 


Table 25 - Final Data Validation for HEDIS 2007 Adolesc ent Well-Care Visits Measure 


Percentage of 
Administrative Medical Record Total Hits Rate Rate Total 
Hits Validated by | Hits Validated by | Validated by | Reported by | Validated | Estimated 
MO HealthNet MCHP =o} ;{o) EQRO* [={o} ;{o) MCHP (DST) | by EQRO 


Blue Advantage Plus NA 31.54% 31.48% 0.07% 
Childrens Mercy Family Health 


Partners 96.67% 42.82% 42.58% 0.24% 


HealthCare USA NA 36.37% 36.67% 
Mercy CarePlus NA 29.49% 29.01% 
Missouri Care 100.00% 44.91% 44.91% 
All MO HealthNet MCHPs 34.81% 34.94% 


Note: NA =Not Applicable; EQRO =Extemal Quality Review Organization (Behavioral Health Concepts, 
Inc.); DST=Data Submission Tool; Administrative/Medical Record Hits Validated by EQRO =Hits the 
EQRO wasable to reproduce from the data provided by the MCHP; Total Hits Validated by EQRO = 
Administrative Hits Validated by EQRO +Medical Record Hits Validated by EQRO; False Positive 
Records =Enor Rate * Rate Reported by MCHP; Rate Validated by EQRO =Total Hits Validated by 
EQRO / Denominator (DST); Total Estimated Bias =Rate Reported by MO HealthNet MC HP - Rate 
Validated by EQRO. Positive numbers represent an overestimate by the MCHP. 





Mtr Performance Management Solutions Group 
oe A division of Behavioral Health Concepts, Inc. 158 


MO HealthNet Managed Care Extemal Quality Review Section 3 


Report of Findings - 2007 Validation of Performance Measures 


Figure 8 - Rates Reported by MO HealthNet MC Os and Validated by EQRO, HEDIS 2007 Adolesc ent 
Well-Care Visits Measure 





Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); BHC, Inc. 2007 Extemal Quality 
Review Performance Measure Validation. 
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HEDIS 2007 FOLLOW-UP AFTER HOSPITALIZATION FOR MENTAL ILLNESS 

Data Integration and Contol 

The objective of this activity wasto assess the MO HealthNet Managed Care health 
plans’ ability to link data from multiple sources. It isbased on the integrity of the 
management information systems and the ability to ensure accuracy of the 
measures. For the HEDIS 2007 Follow-up After Hospitalization for Mental Illness 
measure, the sources of data included enrollment, eligibility, and claim files) Table 
26 summarizes the findings of Attachment V (Data Integration and Control Findings) 
of the CMS Protocol. The rate of itemsthat were Met wascalculated acrossMO 
HealthNet Managed Care health plansand from the number of applicable items for 
each MO HealthNet Managed Care health plan. 


Acrossall MO HealthNet Managed Care health plans, 100.0% of the criteria were 
Met. Each MO HealthNet Managed Care health plan calculating the measure Met 


100.0% of the criteria fordata integration and control. 
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Table 26 - Data Integration and Contol Findings, HEDIS 2007 Follow-up After Hospitalization for Mental Illness 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Number 
Item Audit Elements BA+ CMFHP Partially Met Met Applicable Rate Met 


MCHP/PIHP processes accurately and completely transfer 
data from the transaction files (e.g., membership, provider, 
encounter/claims) into the repository used to keep the data 
until the calculations of the performance measures have been 
5.1 completed and validated. 2 2 2 2 2 5 0 0 5 100.0% 


5.2 Samples of data from repository are complete and accurate. 2 2 2: 2 2 15) 10) {0} 5 100.0% 


MCHP’s/PIHP’s processes to consolidate diversified files, and 
to extract required information from the performance 
5.3 measure repository are appropriate. 2 2 2 2 2 5 0 (0) 5 100.0% 
Actual results of file consolidations or extracts were 
consistent with those which should have resulted according to 
5.4 documented algorithms or specifications. 2 2 D 2 Di 5 fo) (0) 5 100.0% 


Procedures for coordinating the activities of multiple 
subcontractors ensure the accurate, timely, and complete 
5.5 integration of data into the performance measure database. 2 2 2 2 2 5 0 0 5 100.0% 


Computer program reports or documentation reflect vendor 


coordination activities, and no data necessary to performance 
measure reporting are lost or inappropriately modified during 


5.6 transfer. 2 Z 2 2 2 5 ) 0) 5 100.0% 
The repository’s design, program flow charts, and source 
5.7 codes enable analyses and reports. 7) 2 2 2 2 5 (0) (0) 5 100.0% 


Proper linkage mechanisms have been employed to join data 
from all necessary sources (e.g., identifying a member with a 
5.8 given disease/condition). 2 2 2. 2. 2 5 0 0 5 100.0% 
Examine and assess the adequacy of the documentation 
governing the production process, including MCHP/PIHP. 
production activity logs, and MCHP/PIHP staff review of 
5.9 report runs. 2 2 2 2 2 5: 0 10} 5 100.0% 


5.10 Prescribed data cutoff dates were followed. 2D 2 2 2 2 5 0 0 5 100.0% 


The MCHP/PIHP has retained copies of files or databases used 
for performance measure reporting, in the event that results 
5.11 need to be reproduced. 2 2 2 2 2 5 ) () 5 100.0% 
Review documentation standards to determine the extent to 
which the reporting software program is properly 
documented with respect to every aspect of the performance 
measurement reporting repository, including building, 
5.12 maintaining, managing, testing, and report production. D 2 3} 2 R 5 0 0 5 100.0% 
Review the MCHP’s/PIHP’s processes and documentation to 


determine the extent to which they comply with the 
MCHP/PIHP standards associated with reporting program 


5.13 specifications, code review, and testing. 2 2 2 2 2 5 (0) (0) 5 100.0% 
Number Met 13 13 13 13 13 65 0 oO 65 100.0% 
Number Partially Met (¢) 0 0 10) 0 
Number Not Met (0) 10) ie} 10) te) 
Number Applicable 13 13 13 13 13 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was used by the 
MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Metand validated through HEDIS software certification processand proper 
explanation in documentation or proper explanation in documentation. 1 =Partially Met ; 0 =Not Met, validated through HEDIS software certification 
process, but no properexplanation of the process in documentation or no or insufficient explanation in documentation. * Item isnot applicable to the 
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measure being validated. Rate Met =Number Met/ NumberApplicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Documentation of Data and Processes 

The objectives of this activity were to assess the documentation of data collection; 
the process of integrating data into a performance measure set; the procedures 
used to query the data set forsampling, numerators and denominators; and the 
ability to apply properalgorithms. Table 27 summarizes the findings of Attachment 
VI (Data and Processes Used to Calculate and Report Performance Measures) of 
the CMS Protocol. Item 7.2 did not apply asnone of the MO HealthNet Managed 
Care health plans used non-standard codes. Item 7.4 isalso notapplicable asa 
member would not receive services for this measure outside of the MCO’s system. 
Items 7.3 (statistical testing of results and corrections made after processing), 7.5 
(detailed medical record review methodsand practices), 7.7 (sampling 
techniques), 7.9 (data consistency from measure to measure), and 7.10 
(appropriate statistic al functions for confidence intervals) did not apply to the 
measure, asthe measure must be calculated using only the Administrative method. 
All MO HealthNet Managed Care health plans Met 100.0% of the criteria for 


calculating and reporting performance measures. 
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Table 27 - Data and Processes Used to Calculate and Report Performance Measures, HEDIS 2007 Follow-u After Hospitalization for Mental Iliness 


MO HealthNet MCHP All | MO Health HealthNet MCHPs 







Number Neeoe Pes Sa Number 
Item Audit Elements BA+ CMFHP HCUSA MCP MOCare Number Met | Partially Met | Met | PV eye) i et] (1 Rate Met 


Statistical testing of results and any corrections or 
adjustments made after processing. 


Detailed medical record review methods and practices, 

including the qualifications of medical record review 

supervisor and staff; reviewer training materials; audit tools 

used, including completed copies of each record-level 

reviewer determination; all case-level critical performance 

measure data elements used to determine a positive or 

negative event or exclude a case from same; and inter-rater 

reliability testing procedures and results. NA NA NA NA NA NA 
If sampling used, description of sampling techniques, and 

documentation that assures the reviewer that samples used 

for baseline and repeat measurements of the performance 

measures were chosen using the same sampling frame and 

methodology. NA NA NA NA NA NA 


Data that are related from measure to measure are 

consistent (e.g., membership counts, provider totals, number 

of pregnancies and births). NA NA NA NA NA NA 
When determining improvement in pertormance between 

measurement periods, appropriate statistical methodology is 

applied to determine levels of significance of changes. 100.0% 


Number Not Met 1 ri Pe aan 


Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MC HP; Administrative Method wasused by 
the MO HealthNet MCHP and the item relatesto the Hybrid Method; 2 =Met and validated through HEDIS software certification processand proper 
explanation in documentation or properexplanation in documentation. 1 =Partially Met; O=Not Met, validated through HEDIS software certification 
process, but no proper explanation of the process in documentation orno orinsufficient explanation in documentation. * Item isnot applicable to the 
measure being validated. Rate Met =Number Met/ Number Applicable. 




















pi) 100.0% 







Number Partially Met 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Processes Used to Produce Denominators 

The objective of this activity wasto determine the extent to which all eligible 
members were included in the denominator, evaluate the programming and logic 
source codes, and evaluate the specifications foreach measure. Forthe HEDIS 
2007 Follow-up After Hospitalization for Mental Illness measure, the sources of data 
include enrollment, eligibility, and claim files. Table 28 summanzes the findings of 
Attachment X (Denominator Validation Findings) of the CMS Protocol. Items 10.5 
(identification of genderof the member), 10.6 (calculation of member months or 
years), and 10.10 (systems for estimating populations when they are unable to 
accurately be counted) were not applicable to thismeasure. Acrossall MO 
HealthNet Managed Care health plans, 100.0% of criteria forcalculating and 
reporting performance measures were Met. Each MO HealthNet Managed Care 
health plan Met 100.0% of the criteria for the process used to produce 


denominators. 
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Table 28 - Denominator Validation Findings, HEDIS 2007 Follow-up After Hospitalization for Mental Illness 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Number 
Audit Elements BA+ CMFHP HCUSA MOCare Partially Met Met Applicable Rate Met 


All members who were eligible to receive the specified services 

were included in the initial population from which the final 

denominator was produced. This "at risk" population included 

both members who received the services, as well as those who 

did not. This same standard applies to provider groups or other 

relevant populations identified in the specifications of each 

performance measure. 100.0% 


For each measure, programming logic or source code which 
identifies, tracks, and links member enrollment within and 
across product lines (e.g., Medicare and Medicaid), by age and 
sex, as well as through possible periods of enrollment and 
disenrollment, has been appropriately applied according to the 
specifications of each performance measure. 


Calculations of continuous enrollment criteria were correctly 
carried out and applied to each measure (if applicable). 


Proper mathematical operations were used to determine 
patient age or range. 


The MCHP/PIHP can identify the variable(s) that define the 
member's sex in every file or algorithm needed to calculate the 
performance measure denominator, and the MCHP/PIHP can 
explain what classification is carried out if neither of the 
required codes is present.* 


The MCHP/PIHP has correctly calculated member months and 
member years, if applicable to the performance measure.* 


The MCHP/PIHP has properly evaluated the completeness and 

accuracy of any codes used to identify medical events, such as 

diagnoses, procedures, or prescriptions, and these codes have 

been appropriately identified and applied as specified in each 

performance measure. 100.0% 


Any time parameters required by the specifications of the 
performance measure are followed (e.g., cut off dates for data 
collection, counting 30 calendar days after discharge from a 
hospital, etc.). 


members from a denominator were followed. For example, if a 
measure relates to receipt of a specific service, the 
denominator may need to be adjusted to reflect instances in 
which the patient refuses the service or the service is 
contraindicated. 





Systems or methods used by the MCHP/PIHP to estimate 
populations when they cannot be accurately or completely 


10.10 counted (e.g., newborns) are valid.* NA NA NA NA NA (0) (0) 10) 0 NA 
Number Met 7 7 7 7 7 35 (0) (1) 35 100.0% 
Number Partially Met 0 0 (0) 0) 0 
Number Not Met 0 10) 10} 0 0) 
Number Applicable 7 7 7 7 7 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 





Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MCHP; Administrative Method was used by the 
MO HealthNet MCHP and the item relates to the Hybrid Method; 2 =Metand validated through HEDIS software certification processand proper 
explanation in documentation or proper explanation in documentation. 1 =Partially Met; O=Not Met, validated through HEDIS software certification 
process, but no properexplanation of the process in documentation or no or insufficient explanation in documentation. * Item isnot applicable to the 
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measure being validated. Rate Met =Number Met/ NumberApplicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Figure 9 illustrates the rate of eligible members perMO HealthNet Managed Care 
health plan based on the enrollment of all MO HealthNet Managed Care Waiver 
Members as of December 31, 2006 (the end of the CY2006 measurement year). It 
wasexpected that MO HealthNet Managed Care health plans would identify similar 
proportions of eligible members forthe measure. The rate of eligible members 
(percent of eligible members divided by the total enrollment) was calculated forall 
MO HealthNet Managed Care health plans. Two-tailed z-tests of each MO 
HealthNet Managed Care health plan comparing each MO HealthNet Managed 
Care health plan to the state rate of eligible members forall MO HealthNet 
Managed Care health plans were calculated at the 95% level of confidence. 
HealthCare USA (0.52%) and Mercy CarePlus (0.57%) identified significantly lower 
rates that the statewide rate (0.61%) forall MO HealthNet Managed Care health 
plans. The percentage of eligible members reported by Blue-Advantage Plus of 
Kansas City (0.85%) was significantly higher than the average. This vanability could 
be due to differencesin the composition of these particularhealth plans’ 


populations. 
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Figure 9 - MO HealthNet Managed Care Program HEDIS 2007 Follow-up After Hospitalization for Mental 
llIness, Higible Members 
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Note: Erorbarson the y-axis represent 95% confidence intervals, * indicates values are significantly 
lowerorhigherthan the MOHealthNet average at the 95%level of significance. Enrollment as of the 
last week in December 2006 (the measurement year) was used to calculate the rate. 

Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Too! (DST); Missouri Department of Social 
Services, Division of Medical Services, State MPRI Session Screens, enrollment figures for all Waivers, 
December 31, 2006. 


Processes Used to Produce Numerators 

The objectives of this activity were to evaluate the MO HealthNet Managed Care 
health plans ability to accurately identify medical events, evaluate the ability to 
identify events from other sources, evaluate procedures for non-duplicate counting 
of multiple events, review time parameters and the use of non-standard code maps, 
and assess the processes and procedures forcollecting and incorporating medical 
record review data. Forthe HEDIS 2007 Follow-up After Hospitalization for Mental 
Illness measure, the procedures forthe Hybrid Method did not apply, as HEDIS 2007 
technical specifications allow only forthe use of the Administrative Method of 


calculating the measure. 


Table 29 and Table 30 show the numerators, denominators, rates, and confidence 
intervals submitted by the MO HealthNet Managed Care health plans to the SPHA 
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on the DST for the Follow-up After Hospitalization for Mental Illness measure. 
Children’s Mercy Family Health Partners did not report confidence intervals on the 
DST provided to the EQRO, and therefore this interval could not be reported. 
HealthCare USA reported regional rates (Eastem, Central, and Westem); the EQRO 
combined these ratesto calculate a combined rate, and thusthere isno 
confidence interval to report. Similarly, the rate forall MO HealthNet Managed 
Care health plans wascalculated by the EQRO, and no confidence interval is 


included forthe statewide rate. 


J ust as reported in 2006, the rate forall MO HealthNet Managed Care health plans 

was below both the National Medicaid Rate of 39.1% and the National Commercial 
Rate of 56.7% The 7-Day reported rate forall MO HealthNet Managed Care health 
plansin 2007 was 35.52%, which wasa 4.36% increase overthe 7-day rate reported 

in 2006 (the last year this measure was audited by the EQR). 


For 2007, the 30-Day reported rate forall MO HealthNet Managed Care health plans 
was 60.06%, higher than the National Medicaid rate (57.7%) but lower than the 
National Commercial average (75.8%). In 2006, the reported rate forall MO 
HealthNet Managed Care health plans was 52.92%, which was lowerthan both the 
National Medicaid rate and the National Commercial average and wasalso 7.14% 
lower than the 2007 rate. 
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Table 29 - Data Submission and Final Data Validation for HEDIS 2007 Follow-up After Hospitalization for Mental Illness Measure (7 days) 
Number 
Administrative Administrative 
Eligible Hits Reported by | Rate Reported by Hits Validated by| Validated by) Estimated 
MO HealthNet MCHP Population MCHP (DST) MCHP (DST) LCL - UCL (DST) [=o) Xo) Bias 


Blue Advantage Plus 58.67% 52.01 - 65.32% 57.78% 
Childrens Mercy Family Health Partners 48.50% 47.84% 
HealthCare USA 27.35% 27.10% 
Mercy CarePlus 24.68% 20.29 - 29.07% 24.68% 
Missouri Care 42.58% 35.64 - 49.53% 42.58% 
All MO HealthNet MCHPs 









Note: DST =Data Submission Tool; NA =Not Applicable; EQRO =Extemal Quality Review Organization (Behavioral Health Concepts, Inc.); LCL= 
95% Lower Confidence Limit; UCL =95% Upper Confidence Limit. Rate Validated by EQRO =Administrative Hits Validated by EQEO / Eligible 
Population. Estimated Bias =Rate Reported by MCHP (DST) - Rate Validated by EQRO. Postive bias indicates an overestimate. 

Source: MO HealthNet Managed Care Organization HEDIS 2007 Data Submission Tools (DST). 


Table 30 - Data Submission and Final Data Validation for HEDIS 2007 Follow-up After Hospitalization for Mental Illness Measure (30 days) 
Number 
Administrative Administrative 
Eligible Hits Reported by | Rate Reported by Hits Validated by| Validated by) Estimated 
MO HealthNet MCHP Population MCHP (DST) MCHP (DST) LCL - UCL (DST) EQRO Bias 





Blue Advantage Plus 76.00% 70.20 - 81.80% 75.56% 
Childrens Mercy Family Health Partners 88.37% 88.04% 


HealthCare USA 50.58% 50.19% 
Mercy CarePlus 46.31% 41.25 - 51.37% 46.31% 
Missouri Care 63.16% 56.38 - 69.94% 62.68% 
All MO HealthNet MCHPs 


Note: DST =Data Submission Tool; NA =Not Applicable; EQRO =Extemal Quality Review Organization (Behavioral Health Concepts, Inc.); LCL= 
95% Lower Confidence Limit; UCL =95% Upper Confidence Limit. Rate Validated by EQRO =Administrative Hits Validated by EQEO / Eligible 
Population. Estimated Bias =Rate Reported by MCHP (DST) - Rate Validated by EQRO. Postive biasindicates an overestimate. 

Source: MO HealthNet Managed Care Organization HEDIS 2007 Data Submission Tools (DST). 
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Figure 10 and Figure 11 illustrate the 7-Day and 30-Day rates reported by the MO 
HealthNet Managed Care health plans. The rate reported by each MO HealthNet 
Managed Care health plan wascompared with the rate forall MO HealthNet 
Managed Care health plans, with two-tailed z-tests conducted at the 95% 
confidence interval to compare each MO HealthNet Managed Care health plan 
with the rate forall MO HealthNet Managed Care health plans. The 7-Day rates 
reported for Healthcare USA and Mercy CarePlus (27.35% and 24.68%, respectively) 
were significantly lower than the statewide rate forall MO HealthNet Managed 
Care health plans. Blue-Advantage Plus of Kansas City reported a rate (58.67%) 
significantly higherthan the average. Blue-Advantage Plus of Kansas City, 
Children’s Mercy Family Health Partners, and Missouri Care all reported rates higher 
than the National Medicaid Rate (39.1%) and the rate for Blue-Advantage Plus of 


Kansas City wasalso higher than the National Commercial Rate (56.7%). 


The 30-Day rates reported for Blue-Advantage Plus of Kansas City, Children’s Mercy 
Family Health Partners, and Missoun Care were all higherthan both the statewide 
rate (60.06%) and the National Medicaid Rate (57.7%). Blue-Advantage Plus of 
Kansas City and Children’s Mercy Family Health Partners were also higherthan the 
National Commercial Rate (75.8%) and CMFHP wassignific antly higher than the 
average statewide rate forall MO HealthNet Managed Care health plans. 
Healthcare USA and Mercy CarePlus reported ratesthat were significantly lower 
than the statewide rate forall MO HealthNet Managed Care health plans (50.58% 
and 46.31% respectively). 
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Figure 10 - MO HealthNet Managed Care Program HEDIS 2007 Follow-up After Hospitalization for Mental 
IlIness, 7-Day Rates 
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Note: Enorbarson the y-axis represent 95% confidence intervals, * indicates values are significantly 
lowerorhigherthan the MOHealthNet average at the 95%level of significance. 
Sources: MO HealthNet MC HP HEDIS 2007 DST; National Committee for Quality Assurance (NCQA). 


Figure 11 - MO HealthNet Managed Care Program HEDIS 2007 Follow-up After Hospitalization for Mental 
IlIness, 30-Day Rates 










































































National Commerical Average = 75.8%) 
National Medicaid Average = 57.7% 
100.00% 
90.00% - 
80.00% -- 
70.00% - 
60.00% 
5 50.00% - 
40.00% 
30,00% 
20.00% 
10.00% 
0.00% 
All MO 
BA+ CMFHP HCUSA MCP MOCare HealthNet 
MCHPs 
& 30-Day Rate 76,00% 88.37% 50.58% 46.31% 63, 16% 60.06%, 











Note: Erorbarson the y-axis represent 95% confidence intervals. 
Sources: MO HealthNet MCHP HEDIS 2007 DST; National Committee for Quality Assurance (NCQA). 
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Table 31 shows the validation of numerators based on the review of numerator 
extract filesand the medical record review. Item 13.2 wasnot applicable to the 
HEDIS 2007 Follow-up After Hospitalization for Mental Illness measure. Item 13.6 did 
not apply, asnone of the MO HealthNet Managed Care health plans used non- 
standard codes. Items 13.8 through 13.13 relate to the Hybrid Method of calculation 
and were not applicable to the measure. Acrossall MO HealthNet Managed Care 
health plans, 100% of the criterna for calculating numerators were met. Each of the 
MO HealthNet Managed Care health plans Met 100.0% of criteria forthe calculation 


of the numerator. 
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Table 31 - Numerator Validation Findings, HEDIS 2007 Follow-up After Hospitalization for Mental IlIness Measure 





MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Not Nu 
Audit Elements BA+ EV Wat Met Applicable Rate Met 


The MCHP/PIHP has used the appropriate data, including 
linked data from separate data sets, to identify the entire 
13.1 at-risk population. 2 2 2 2 2 5 0 0 5 100.0% 
The MCHP/PIHP has in place and utilizes procedures to 
capture data for those performance indicators that could be 
easily under-reported due to the availability of services 
13.2 outside the MCHP/PIHP. NA NA NA NA NA 0 () 0 Co) NA 
The MCHP's/PIHP's use of codes used to identify medical 
events are complete, accurate, and specific in correctly 


13.3 describing what has transpired and when. 2 2 2 2 2 5 0 0 5 100.0% 
when classifying members for inclusion or exclusion in the 

13.4 numerator. 2 2 2 2 2 5 0 0 5 100.0% 
The MCHP/PIHP has avoided or eliminated all double- 

13.5 counted members or numerator events. 2 2 2 2 2 5 0 0 5 100.0% 


Any non-standard codes used in determining the numerator 
have been mapped to a standard coding scheme in a 
manner that is consistent, complete, and reproducible as 
evidenced by a review of the programming logic or a 
13.6 demonstration of the program. NA NA NA NA NA (0) (0) fo) fo) NA 
Any time parameters required by the specifications of the 
performance measure are adhered to (i.e., that the 
measured event occurred during the time period specified 
13.7 or defined in the performance measure). 2 2 2 2 2 5 (0) (0) 5 100.0% 


Medical record reviews and abstractions have been carried 
out in a manner that facilitates the collection of complete, 


13.8 accurate, and valid data. NA NA NA NA NA 0 0 ie) ie) NA 
Record review staff have been properly trained and 

13.9 supervised for the task. NA NA NA NA NA 0 0 0 0 NA 
Record abstraction tools require the appropriate notation 

13.10 that the measured event occurred. NA NA NA NA NA (0) (0) (0) (0) NA 


Record abstraction tools require notation of the results or 
13.11 findings of the measured event (if applicable). NA NA NA NA NA 0 0 0 0 NA 


Data included in the record extract files are consistent with 
data found in the medical records as evidenced by a review 
of a sample of medical record for applicable performance 
measures. (From Medical Record Review Validation Tools- 
13.12 Table 5, ATTACHMENT XI!) NA NA NA NA NA 0 0 0 0 NA 


The process of integrating administrative data and medical 
record data for the purpose of determining the numerator 


13.13 is consistent and valid. NA NA NA NA NA (0) (0) (0) 0 NA 
Number Met 5 5 5 5 5 25 o oO 25 100.0% 
Number Partially Met 0 (0) 0 0 10) 
Number Not Met {0} 10) ie} 0 0) 
Number Applicable 5 5 5 5 5 
Rate Met 100.0% 100.0% 100.0% 100.0% 100.0% 





Note: A =Administrative; H =Hybrid; NA =Not Applicable to the method employed by the MO HealthNet MC HP; Administrative Method wasused by 
the MO HealthNet MCHP and the item relatesto the Hybrid Method; 2 =Met and validated through HEDIS software certification processand proper 
explanation in documentation or properexplanation in documentation. 1 =Partially Met ; O =Not Met, validated through HEDIS software certification 
process, but no proper explanation of the process in documentation orno or insufficient explanation in documentation. * Item isnot applicable to the 
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measure being validated. Rate Met =Number Met/ Number Applicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation. 
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Submission of Measures to the State 

Reports from the SPHA were obtained regarding the submission of the HEDIS 2007 
Follow-up After Hospitalization for Mental Illness Measure. All MO HealthNet 
Managed Care health planscalculated and submitted the measure to the SPHA 
and SMA. The 7-Day ratesreported by MO HealthNet Managed Care health plans 
ranged from 24.68% (Mercy CarePlus) to 58.76% (Blue-Advantage Plus of Kansas 
City). The rate of all MO HealthNet Managed Care health planscalculated based 
on data validated by the EQRO was 35.21% The MO HealthNet Managed Care 
health plans reported an overall rate of 35.52%, a 0.31% overestimate (see Figure 
12). The 30-Day rate reported by MO HealthNet Managed Care health plans 
ranged from 46.31% (Mercy CarePlus) to 88.37% (Children’s Mercy Family Health 
Partners). The rate of all MO HealthNet Managed Care health plans calculated 
based on data validated by the EQRO was59.75%. The rate reported by MO 
HealthNet Managed Care health plans was 60.06%, a 0.31% overestimate (see 
Figure 13). 


Figure 12 - Rates Reported by MO HealthNet MCOs and Validated by EQRO, HEDIS 2007 Follow-up After 
Hospitalization for Mental Illness Measure (7-Day Rates) 
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Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); BHC, Inc. 2007 Extemal Quality 
Review Performance Measure Validation. 
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Figure 13 - Rates Reported by MO HealthNet MCOs and Validated by EQRO, HEDIS 2007 Follow-up After 
Hospitalization for Mental Illness Measure (30-Day Rates) 
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BAt CMFHP HCUSA MCP MOCare All MO HealthNet 
MCHPs 
@ Reported 30-Day Rate 76.00% 88.37% 50.58% 46.31% 63.16% 60.06% 
OEQRO Validated Rate 30-Day 75.56% 88.04% 50.19% 46.31% 62.68% 59.75% 











Sources: MO HealthNet MCHP HEDIS 2007 Data Submission Tool (DST); BHC, Inc. 2007 Extemal Quality 
Review Performance Measure Validation. 


Final Validation Findings 

Table 32, Table 33, and Table 34 provide summanes of ratings acrossall Protocol 
Attachments foreach MO HealthNet Managed Care health plan and measure 
validated. The rate of compliance with the calculation of each of the three 
performance measures was 100% acrossallMCOs. The EQRO found each MCO to 


be in complete compliance. 


Table 32 - Summary of Attachment Ratings, HEDIS 2007 Annual Dental Visit Measure 





All MO HealthNet MCOs rN me) 
HealthNet 
All Audit Elements CMFHP HCUSA MCP MOCare MCOs 
Number Met 30 30 30 30 30 150 
Number Partially Met 0 0 0 0 0 (0) 
Number Not Met 0 0 0 0 0 oO 
Number Applicable 30 30 30 30 30 150 
Rate Met 100% 100% 100% 100% 100% 100.0% 


Note: Rate Met =Number Met/ Number Applicable. 
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Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 


Table 33 - Summary of Attachment Ratings, HEDIS 2007 Adolesc ent Well-Care Measure 





All MO HealthNet MCOs rN mice) 
HealthNet 
All Audit Elements CMFHP HCUSA MCP MOCare MCOs 
Number Met 29 49 29 29 49 184 
Number Partially Met 0 0 0 0 0 (0) 
Number Not Met 0 0 0 0 0 oO 
Number Applicable 29 49 29 29 49 184 
Rate Met 100% 100% 100% 100% 100% 100.0% 


Note: Rate Met =Number Met/ Number Applicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 


Table 34 - Summary of Attachment Ratings, HEDIS 2007 Follow-up After Hospitalization for Mental Illness 
Measure 





All MO HealthNet MCOs rNIM le) 
HealthNet 
All Audit Elements CMFHP HCUSA MCP MOCare MCOs 
Number Met 29 29 29 29 29 145 
Number Partially Met 0 0 0 0 0 (0) 
Number Not Met 0 0 0 0 0 oO 
Number Applicable 29 29 29 29 29 145 
Rate Met 100% 100% 100% 100% 100% 100.0% 


Note: Rate Met =Number Met/ Number Applicable. 
Source: BHC, Inc. 2007 Extemal Quality Review Performance Measure Validation 
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Table 35 summarizes the final audit ratings for each of the performance measures 
and MO HealthNet Managed Care health plans. The final audit findings foreach of 
the measures was based on the evaluation of processes for calculating and 
reporting the measures, medical record review validation findings, and MO 
HealthNet Managed Care health plan extract files from repositories. The ratings 
were based on the impact of medical record review findings and the degree of 
overestimation of the rate asvalidated by the EQRO. The calculation of measures 
wasconsidered invalid if the specifications were not properly followed, orif the rate 
validated by the EQRO fell outside the confidence intervals forthe measure 
reported by the MO HealthNet Managed Care health plans on the DST. 
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Table 35 - Summary of EQRO Final Audit Rati 


MO HealthNet Managed 


Care health plan 
Blue-Advantage Plus of 
Kansas City 
Children’s Mercy Family 
Health Partners 


Healthcare USA 


Mercy CarePlus 


Missouri Care 


Annual Dental Visit 
Substantially Compliant 


Substantially Compliant 
Substantially Compliant 
Substantially Compliant 


Substantially Compliant 


Adolescent Well-Care 
Visit 
Substantially Compliant 
Substantially Compliant 
Substantially Compliant 


Substantially Compliant 


Fully Compliant 


Validation of Performance Measures 


gs, HEDIS 2007 Performance Measures 


Follow-up After 
Hospitalization for 
Mental I IIness 


Substantially Compliant 
Substantially Compliant 
Substantially Compliant 


Fully Compliant 





Substantially Compliant 


Missoun Care reported a rate forthe HEDIS 2007 Adolescent Well-Care Visits measure 


that wasable to be fully validated by the EQRO, gamering a rating of Fully 


Compliant. Likewise, the HEDIS 2007 Follow-Up After Hospitalization for Mental Illness 


rates for Mercy CarePlus were Fully Compliant. Although all other ratings were not 


fully validated, each of them fell within the expected confidence intervals and 


therefore were determined to be Substantially Compliant. 


3.5 Conclusions 


In calculating the measures, MO HealthNet Managed Care health planshave 


adequate management information systems for capturing and storing enrollment, 


eligibility, and claims information for the calculation of the three HEDIS 2007 


measures validated. 


Among MO HealthNet Managed Care health plans there wasgood documentation 


of the HEDIS 2007 rate production process. 


The rates of medical record submission forthe one measure allowing the use of the 
Hybrid Methodology was superb, with all MO HealthNet Managed Care health 


plans submitting 100% of the records requested. 


QUALITY OF CARE 
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The HEDIS 2007 Follow-Up After Hospitalization for Mental Illness measure is 

categorized asan Effectiveness of Care measure and isdesgned to measure the 


effec tiveness/ quality of care received by health plan members. 


One MO HealthNet Managed Care health plan was Fully Compliant with the 
specifications for calculation of this measure. The four remaining MO HealthNet 
Managed Care health plans were substantially complaint with the specifications for 
calculation of this measure. (Harmony isnot included in this evaluation as they were 


not a Missoun provider during the HEDIS 2007 measurement period.) 


Forthe 7-day follow up rate, three MO HealthNet Managed Care health plans (BA+, 
CMFHP and MO Care) reported rates (58.67%, 48.50% and 42.58%, respectively) that 
were higher than the National Medicaid Average (39.1%) for this measure and one 
health plan (BA+ reported a rate higherthan the National Commercial Average 
(56.7%). 


The 7-Day reported rate forall MO HealthNet Managed Care health plans in 2007 
(35.52%) wasa 4.36% increase overthe 7-day rate reported in 2006 (the last year this 


measure was audited by the EQR). 


Forthe 30-day follow up rate, three MO HealthNet Managed Care health plans 
(BA+, CMFHP and MO Care) reported rates (76.00%, 88.37% and 63.16%, 
respectively) that were higherthan the National Medicaid Average (57.7%) for this 
measure and two health plans (BA+and CMFHP) reported rates higher than the 


National Commercial Average (75.0%). 


The 30-Day reported rate forall MO HealthNet Managed Care health plans in 2007 
(60.06%) wasa 7.14% increase over the 30-day rate reported in 2006 (the last year 
this measure was audited by the EQR). 


Due to the high rates reported for this measure it can be concluded that MO 


HealthNet Managed Care health plan membersare receiving a higher quality of 
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care in the area of Follow-Up After Hospitalization for Mental Illness than other 


Medicaid recipients across the country. 


ACCESS TO CARE 
The HEDIS 2007 Annual Dental Visit measure is categonzed asan Access/Availa bility 


of Service measure and isdesignated to measure the accessto care received. 


Forthe Annual Dental Visit measure, all five MC HealthNet Managed Care health 


plans reviewed were substantially compliant with the calculation of this measure. 


The rate for AllMO HealthNet Managed Care health plans of Annual Dental visits 
improved by 2.74% from the 2005 rate (the last year this measure was validated by 
the EQRO) of 29.76%to the 2007 rate of 32.50%. Thereby showing an increased level 


of dental care received in Missoun during the HEDIS 2007 measurement year. 


For the Annual Dental Visit measure, none of the health plans reported a rate higher 
than the National Medicaid Average (42.5%). 


TIMELINESS OF CARE 

The HEDIS 2007 Adolescent Well Care Visits is categonzed asa Use of Services 
measure and isdesgnated to measure the timeliness of the care received. To 
increase the rate for both of these measures, age specific services must be 


delivered to members ona yearly basis. 


Forthe Adolescent Well Care Visits measure, one health plan was fully compliant 
with the specifications for calculation of this measure and the remaining four were 


substantially compliant with the measure’s calculation. 


Forthe Adolescent Well Care Visits measure, two health plans (CMFHP and MO 
Care) reported rates (42.82%and 44.91%, respectively) higher than the National 
Commercial Average (40.3%) and one health plan (MO Care) reported a rate 
higher than the National Medicaid Rate (43.6%), as well. 
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The rate for All MO HealthNet Managed Care health plans improved by 4.68% from 
the 2004 reported rate of 30.13% forall health plans (the last year this measure was 
validated by the EQRO) to the 2007 rate forall health plans of 34.81% Thereby 
showing an increased level of well care visits delivered to adolescents in Missouri 


during the HEDIS 2007 measurement year. 


RECOMMENDATIONS 

1. The SMA should consider requiring the Hybrid Method of calculation forsome 
HEDIS measures. The two health plans who calculated the Adolescent Well 
Care Visits measure hybridly (CMFHP and MO Care) had the highest 
validated rates (42.82 %and 44.91%, respectively) and ratesabove both 
National benchmarks (National Commercial rate 40.3% and National 
Medicaid rate 43.6%). 

2. MO HealthNet Managed Care health plans with significantly lower rates of 
eligible members (Annual Dental Visit (MCP), Adolescent Well Care Visits 
(CMFHP, MO Care) and Follow Up After Hospitalization for Mental Illness 
(HCUSA, MCP)) and administrative hits (Annual Dental Visit (MO Care), 
Adolescent Well Care Visits (MCP) and Follow UP After Hospitalization for 
Mental Illness (HCUSA, MCP)) should closely examine the potential reasons for 
fewermembersand/or services identified. Thismay be due to member 
characteristics, but is more likely due to administration proceduresand 
system characteristics such asthe proportion of members receiving services 
from capitated providers. Identifying methods of improving administrative 
hits will improve the accuracy in calculating the measures. 

3. The SMA should continue to have the EQRO validate the calculation of at 
least one measure from yearto year, forcomparison and analysis of trend 
data. 

4. MO HealthNet Managed Care health plans should run query reports early 
enough in the HEDIS season so that they may effectuate change in rates 


where interventions could easily be employed. 
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4.0 VALIDATION OF ENCOUNTER DATA 
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4.1 Definition 


“Forthe purposes of this protocol, an encounter refers to the electronic record ofa 
service provided to an MCO enrollee by both institutional and practitioner providers 
(regardless of how the provider was paid) when the service would traditionally be a 


billable service under Fee-for-Service (FFS) reimbursement systems,” !2 


An encounter is the unit of service provided to a Member by the health plan. 
Encounterdata provides the same type of information found ona claim form. It 
doesnot substitute for medical record documentation, but should be consistent with 
and supported by medical record documentation (e.g. date of procedure, type of 
procedure). The MO HealthNet Managed Care health plans’ contract with the 
State Medicaid Agency (SMA; Missoun Department of Social Services, MO HealthNet 
Division; MHD) details the requirements foran acceptable submission of an 
encounter. The SMA’s requirements for encounter data submitted by the MO 
HealthNet Managed Care health plans include the type of encounter data and 


required data fields. 


4.2 Purpose and Objectives 


“Encounter data can be used to assessand improve quality, 
as well as monitor program integrity and determine 
Capitation payment rates. However, in order for encounter 
data to effectively serve these pumoses, it must be valid; i.e., 
complete and accurate...This protocol specifies processes 
for assessing the completeness and accuracy of encounter 
data submitted by MCOsand PIHPs to the State. It also can 
assist in the improvement of the processes associated with 
the collection and submission of encounter data to State 
Medicaid agencies.”3 





2 Department of Health and Human Services. Centers for Medicare and Medicaid Services (2002). Validating 
Encounter Data: A protocol for use in Conducting Medicaid External Quality Review Activities, Final Protocol, 
Version 1.0, May 1, 2002. Washington, D.C.: Author. 


3 Ibid. 
Ce Performance Management Solutions Group 189 
ae A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 4 
Report of Findings - 2007 Validation of Encounter Data 
Three objectives forthe encounter validation were identified. They included: 
assessing the quality of data for required fields for each claim type; evaluating the 
representativeness (orcompleteness) of the SMA encounter claims database for 
MO HealthNet Managed Care health plan paid and unpaid claims; and validating 
medical records against the SMA encounter claimsdatabase. The following were 


the objectivesand associated evaluation questions. 
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1. The first objective wasto obtain a quality baseline of the SMA encounter 


3 


claim database (completeness, accuracy, and reasonableness). The 
altemative hypothesis was that all data fields in the SMA encounter claims 
database consst of valid (Complete, accurate, and reasonable) encounter 
claim data. Appendix 6 shows the recommended minimum criteria 
established forcompletenessand accuracy of specific data fields. Several 


evaluation questions were addressed: 


e Whatisthe baseline level of completeness, accuracy, and reasonableness of the 
critical fields? 

e Whatisthe level of volume and consistency of services? 

e Whatare the data quality issues associated with the processing of encounter data? 

e What problemsare there with how files are compiled and submitted by the health 
plan? 

e Whattypesof encounterclaim data are missing and why? 


The second objective wasto examine the match between MO HealthNet 
Managed Care health plan claims (paid and unpaid) and the SMA 
encounter paid claimsdatabase. This would facilitate identification of the 
level of completeness of the SMA encounter claims database as represented 
by MO HealthNet Managed Care health planspaid claims. The altemative 
hypotheses were that 100% of MO HealthNet Managed Care health plans 
paid claims are represented in the SMA encounterclaims database, and 
0.00% of MO HealthNet Managed Care health plans unpaid claims are 
represented in the SMA encounterclaimsdatabase. Several evaluation 


questions were posed: 


e Whattypesof paid encounter data are missing and why? 

e Whatisthe fault/match rate of paid and unpaid encounter claims in the SMA 
encounter claim database and the MO HealthNet Managed Care health plans claims 
database? 

e Whatservicesare being provided that are not being paid? 

e How many servicesare being provided that are not being paid? 


The third objective wasto validate the SMA encounterclaims (paid) 
database against medical record documentation and obtain a baseline 
fault (error) rate forthe level of accuracy of the SMA encounterclaims 
database relative to the servicesdelivered by MO HealthNet Managed Care 
health plan providers. The altemative hypothesis was that there isa 100% 


match between the encounter claim data in the medical record and the 
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data in the SMA encounterclaims database. Accuracy ormatch rates of 
70% or greater are anticipated fornew Medicaid managed care 


organizations'*. Several evaluation questions were addressed: 


e To what extent do the claimsin the SMA encounter claims database reflect the 
information documented in the medical record? 

e Whatisthe fault/match rate between SMA encounterclaims and medical records? 

e What typesof enorsare noted? 





4 Medstat (1999). A Guide for States to Assist in the Collection and Analysis of Medicaid Managed Care Data: 
Second Edition. 


a ree corm om BHC 
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4.3 Technical Methods 


TIME FRAME 
The dates of service from J uly 1, 2007 through September 30, 2007 were selected by 


the SMA forthe three encounter data validation objectives. 


PROCEDURES FOR DATA COLLECTION 

For the first objective, the SMA encounter claims extract file was used to examine 
the completeness, accuracy, and reasonableness of the critical fields and to 
calculate the rate of each claim type per 1,000 members by MO HealthNet 
Managed Care health plans. There are sx claim types described in the SMA Health 
Plan Layout Manual: | =Inpatient claim type; M =Medical claim type; O = 
Outpatient Hospital claim type; D =Dental claim type; H =Home Health claim type; 
and P =Phamacy claim type. Inpatient, Outpatient and Home Health claim types 
are submitted using a Universal Billing (UB-92) file layout, Medical and Dental claim 
types are submitted using a National Standard Format/Centers for Medicare and 
Medicaid Services 1500 (NSF/CMS 1500) file layout, and the Pharmacy claims are 
submitted using the National Council for Prescription Drug Programs, version 3 file 
layout (NCPDP v.3.0). All claims are sent from the MO HealthNet Managed Care 
health plans to the SMA through the SMA claims vendor, InfoC rossing, and claim 
types are assigned by the Medicaid Management Information System (MMIS). 


After review and approval of the technical methodsand objectives by the SMA, the 
EQRO reviewed, discussed with the SMA, and submitted a data request (see 
Appendix 7) forthe SMA encounter claims extract file to be validated foreach 
claim type and each MO HealthNet Managed Care health plan. The file request 
wasmade to the SMA onJ anuary 9, 2008 and received on February 29, 2008 by the 
EQRO. The SMA reviewed and approved the data request and parameters forthe 
designated fieldsto be validated by the EQRO. 
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For the second objective of comparing the SMA encounter claims with MO 
HealthNet Managed Care health plans’ paid and unpaid claims, the SMA 
encounter claims extract file was parsed by type of file layout (NSF/CMS 1500, UB-92, 
or NCPDP v.3.0) in preparation for matching against MO HealthNet Managed Care 
health plan paid and unpaid claims. A cross-walk for matching MMIS field names 
with those of the three national standards file layouts wasdeveloped and submitted 
to the SMA for review (February 8, 2005) and approval (March 29, 2005). MO 
HealthNet Managed Care health plans were requested to provide paid and unpaid 
claims forthe designated period on the sample of membersselected by the EQRO. 
While last year all sx MO HealthNet Managed Care health planssupplied the 
appropnate information required, this year, only five of the six health plans submitted 


the requested information. 


The number of Medical encounter claims in the SMA encounter claims extract file 
wasused forsample size estimation forthe third objective and analysis of the 
evaluation questions. To examine the degree of match between the SMA 
encounter claimsdatabase and medical record procedures and diagnoses, 100 
encounters from each MO HealthNet Managed Care health plan were randomly 
selected from Medical claim types forthe period of J uly 1, 2007 through September 
30, 2007 for medical record review. Appendix 8, Appendix 9, and Appendix 10 
contain letters of request to providers for medical records, the Table of Contents for 
the Medical Record Review Training Manual, and copies of medical record review 


tools. Several challengesin requesting the data were addressed. 


ANALYSES 

To assess the accuracy and completeness of the SMA encounterclaims database, 
the SMA encounterclaims extract file forall MO HealthNet Managed Care health 
plan paid encounter claims representing services rendered from J uly 1, 2007 through 
September 30, 2007 was analyzed for completeness, accuracy, and reasonableness 
(validity) of the data in each “critical”, or required field examined. The Inpatient, 


Medical, Dental, Home Health, Outpatient Hospital, Pharmacy, and critical fields 
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were chosen by the SMA for analysis, with an established threshold of 100% for 


completion, accuracy, and validity: 
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Medical (NSF/ CMS 1500) Claim Type 
Outpatient Claim Type 

Recipient |D 

First Date of Service 

Last Date of Service 

Place of Service 

Units of Service 

Procedure Code 

Inpatient Diagnosis (five diagnosis fields) 


Dental (NSF/ CMS 1500) Claim Type 
Outpatient Claim Type 

Recipient |D 

First Date of Service 

Last Date of Service 

Units of Service 

Procedure Code 


Home Health (UB-92) Claim Type 
Outpatient Claim Type 

Recipient |D 

First Date of Service 

Last Date of Service 

Units of Service 

Procedure Code 

Revenue Code 

Inpatient Diagnosis (five diagnosis fields) 


Inpatient (UB-92) Claim Type 
Inpatient Claim Type 


Validation of Encounter Data 


Recipient ID 

Admission Type 
Admission Date 
Discharge Date 

Bill Type 

Patient Discharge Status 
Inpatient Diagnosis (five diagnosis fields) 
First Date of Billing 

Last Date of Billing 
Revenue Code 

Units of Service 


Outpatient Hospital (UB-92) Claim Type 
Outpatient Claim Type 

Recipient 1D 

First Date of Service 

Last Date of Service 

Place of Service 

Units of Service 

Procedure Code 

Inpatient Diagnosis (five diagnosis fields) 


Pharmacy (NCPDP v.3.0) 
Recipient ID 

Dispensing Date 

Pharmacy Prescription Number 
Drug Quantity Dispensed 
Number of Days Supply 
National Drug Code 


Each field wasexamined forthe presence orabsence of data (completeness), the 
correct type and size of information (accuracy), and the presence of valid values 


(reasonableness) or validity using the criteria listed below. 


Completeness: The extent to which an encounter claim field contains data (either 
present or absent). 


Accuracy: The extent to which an encounter claim field contains the correct 


type of information (e.g., numeric, alpha, alphanumeric) in the 
proper format (e.g., mm/dd/yyyy for date field). 


Reasonableness (Validity): The extent to which an encounter claim field represents a valid value 
(e.g., an actual procedure code, actual birth date) 





For the validation of the SMA encounter claims extract file with MO HealthNet 
Managed Care health plan medical records, the goal wasto validate the 
procedure code and diagnosis code fields for the Outpatient claim types in the 

SMA encounter claims database against the information provided in the medical 
record. The minimum number of records required forthe evaluation of two variables 
(procedure and diagnosiscode) with an estimated enor rate of 30% (based on 
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Medstat estimates}5), reliability of 1.96 (95% statistical significance), and a 
meaningful difference of 55% were calculated using the number of Medical 
encounters in the SMA encounter claims file foreach MO HealthNet Managed Care 
health plan (see Figure 14). There were no differences in the number of required 
records for MO HealthNet Managed Care health plans, with the minimum required 
sample size of 88. A total of 100 encounters foreach MO HealthNet Managed Care 
health plan were randomly selected for medical record review using a probability 


sample. 


Figure 14 - Formula for Calculating Minimum Required Sample Size 
_ z?NP,(1-P,) 
(N -1) e?P\2 + z?P\(1 = P,) 
Where Py, =Estimated True Enor Rate; meaningful difference between true and estimated value ;z= 


level of reliability; e=1(Py - meaningful difference)/meaningful difference; N =number of Medicaid 
Claim Types forthe period J anuary 1, 2004-March 31, 2004; n =Minimum required sample size16 


4.4 Findings 


One limitation of the present analysis is that the encounter claim completeness and 
accuracy analysis was based on paid encounterclaimsand doesnot account for 
all claims that are submitted and rejected through system edits. Also, because the 
SMA encounter claims extract file was forservice dates from J uly 1, 2007 through 
September 30, 2007, some service dates might extend beyond this period. For 
example, if the first date of service was laterin the period (e.g., September 30, 2007), 
the last date of service may extend beyond the period specified by SMA 
parameters forthe validation process (e.g., a Discharge Date of October 1, 2007). 
When last dates of service appeared to be within a reasonable period, dates 


outside the valid range were considered valid. In addition, the second through fifth 


15 Medstat (1999). A Guide for States to Assist in the Collection and Analysis of Medicaid Managed Care Data: 
Second Edition. 

6 Levy, P.S. & Lemeshow, S. L. (1999). Sampling of Populations: Methods and Applications, Third Edition, 
John Wiley and Sons: New York; see box 3.5 for Exact and approximate sample sizes required under simple 
random sampling for proportions. 
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diagnosis code fields are required when the information is available. Not all 
encounters had five diagnoses. Therefore, 100.00% completion of these fields would 
not be expected. Conclusions regarding the extent to which the encounter claims 
database reflects the accuracy and completeness of rejected claims cannot be 
drawn. Thereby, the information contained in thisaggregate section is available at 
the MO HealthNet Managed Care health plan level in the individual MO HealthNet 
Managed Care health plan summanes. The findings of the encounter data 
validation are presented in response to each evaluation question, by claim type 
and critical field forall MO HealthNet Managed Care health plans. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of the 
Critical fields? 


Forthe Medical claim type, there were a total of 961,822 encounter claims paid by 


the SMA forthe period J uly 1, 2007 through September 30, 2007. 

The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

The Outpatient First Date of Service field was 100.00% complete, accurate and valid. 
The Outpatient Last Date of Service field was 100.00% complete, accurate and valid. 


The Outpatient Units of Service field was 100.00%c omplete, accurate, and valid. 


AU FF WN 


The Outpatient Procedure Code field was 100.00%complete, accurate, and 99.99% valid (6 
fields contained invalid codes). 
7. The Outpatient Place of Service field was 100.00% complete, accurate and valid. 


8. The first, Diagnosis Code fields were 100.00% complete, accurate and valid. 


9. Although the second through fifth Diagnosis Code fields are optional according to the Health 
Plan Record Layout Manual, they all fell well below the 100% threshold established by the SMA 
forthis validation. The second Diagnosis Code filed was 28.44% complete, accurate and valid. 
The remaining fields (n =688,217 were blank). The third Diagnosis Code field was 11.32% 
complete, accurate and valid. The remaining fields (n=852,994) were blank (incomplete, 
inaccurate, and invalid). The fourth diagnosis code field was 5.37% complete, accurate and 
valid. The remaining fields (n =910,126) were blank (incomplete, inaccurate, and invalid). The 
fifth Diagnosis Code field was0.01% complete and accurate. The remaining fields (n=961, 702) 
were blank, The fifth Diagnosis Code field was 0.0% valid with 961,702 fields blank and 120 fields 


containing the invalid code.XO1. 


Forthe Dental claim type, there were 134,974 encounter claims paid by the SMA for 
the period J uly 1, 2007 through September 30, 2007. All critical fields examined were 
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100.00% complete, accurate and valid forall MO HealthNet Managed Care health 
plans. 
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Forthe Home Health claim type, there wer a total of 235 encounterclaims paid by 
the SMA forthe period J uly 1, 2007 through September 30, 2007. 
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10. 


11. 


The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

The Recipient ID field was 100.00% complete, accurate and valid. 

The First Date of Service field was 100.00% complete, accurate and valid. 

The Last Date of Service field was 100.00% complete, accurate and valid. 

The Units of Service field was 100.00% complete, accurate and valid. 

The Procedure Code field was 79.57% complete, accurate and valid. The remaining fields (n = 
48) were blank (incomplete, inaccurate, and invalid). 

The first, Diagnosis Code field was 100.00% complete, accurate and valid. 

The second Diagnosis Code filed was 28.09% complete, accurate and valid. The remaining 
fields (nN=169) were blank (incomplete, inaccurate, and invalid). 

The third Diagnosis Code field was 20.0% complete, accurate and valid. The remaining fields 
(n=188) were blank (incomplete, inaccurate, and invalid). 

The fourth Diagnosis Code field was 6.38% complete, accurate and valid. The remaining fields 
(n =220) were blank (incomplete, inaccurate, and invalid). 

The fifth Diagnosis Code field was 2.56% complete, accurate and valid. The remaining fields (n 


=229) were blank (incomplete, inaccurate, and invalid). 


For the Inpatient claim type, there were a total of 102,232 encounter claims paid by 
the SMA forthe period J uly 1, 2007 through September 30, 2007. 


1. 
2. 
3. 
4. 


10. 
11. 





The Inpatient Claim Type field was 100.00% complete, accurate and valid. 

The Recipient ID field was 100.00%c omplete, accurate and valid. 

The Admission Type field was 100.00% complete, accurate, and valid. 

The Admission Date field was 100.00% complete and 99.99% accurate, and valid. Invalid 
entries of 11/13/06, 12/29/06 and 01/11/07 were present in 127 fields. 

The Discharge Date field was 100.00% complete and 97.80%accurate and valid. Invalid entries 
of “99999999” were present in 2244 fields. 

The Bill Type field was 100.00%complete, accurate and valid. 

The Patient Status field was 100.00% complete, accurate and valid. 

The first Diagnosis Code field was 100.00% complete, accurate and 99.99% valid. The 
remaining fields (n =77) were blank (incomplete, inaccurate, and invalid). 

The second, third, fourth, and fifth Diagnosis Code fields fell below the 100% threshold for 
completeness, accuracy, and validity established by the SMA (95.95%, 79.91%, 70.83%, and 
56.19%, respectively). The remaining fields were blank (incomplete, inaccurate, and invalid) or 
contained invalid code: X01. 

The First Date of Billing field was 100.00% complete, accurate and valid. 

The Last Date of Billing field was 100.00% complete, accurate and valid. 
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12. The Revenue Code field was 100%complete, accurate, and valid. 


13. The Units of Service field was 100.00% complete, accurate and valid. 
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Forthe Outpatient Hospital claim type, there were a total of 477,101 encounter 
claims paid by the SMA forthe period J uly 1, 2007 through September 30, 2007. 


The Outpatient Claim Type field was 100.00% complete, accurate and valid. 
The Recipient ID field was 100.00% complete, accurate and valid. 

The First Date of Service field was 100.00% complete and accurate, and valid. 
The Last Date of Service field was 100.00% complete and accurate, and valid. 


The Units of Service field was 100.00% complete, accurate and valid. 


AU FF WN PR 


The Outpatient Procedure Code field was 99.13% complete and accurate. The remaining 
fields were blank (incomplete, inaccurate, and invalid). The fields were 63.12% valid. There 
were 148,572 fields containing “00000” and 23,210 containing invalid codes. 

7. The Outpatient Revenue Code field was 100.00% complete, accurate and valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. Although the second through fifth Diagnosis Code fields are optional according to the Health 
Plan Record Layout Manual, they all fell well below the 100% threshold established by the SMA 
forthis validation. . The Diagnosis Code fields were 77.41%, 59.66%, 31.26% and 15.52% 
complete, accurate and valid (incomplete, inaccurate, and invalid). The remaining fields 
were blank (n= 107,758; 192,463; 327,964; 403,034 respectively) (incomplete, inaccurate, and 
invalid) or contained the invalid code X01 (n=30). 


Forthe Pharmacy claim type, there were 450,070 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. All fields examined were 100.00% 
complete, accurate and valid (Recipient ID, First Date of Service, Prescription 


Number, Quantity Dispensed, Days Supply, and National Drug Code). 


What is the Level of Volume and Consistency of Servic es? 

One method of examining the level, consistency, and volume of services isto assess 
the extent to which each MO HealthNet Managed Care health plan isconsstent 
with the remaining MO HealthNet Managed Care health plansand the average of 
all MO HealthNet Managed Care health plansservices represented in the SMA 
encounter claimsdatabase. The level, consistency, and volume of services 
represented in the SMA encounter claims database isa function of the acceptance 
of encounter claim submissions. It isalso a function of the processof manipulation 
of data from national standard layouts for Medical (NSF/CMS 1500); Dental 
(NSF/C MS 1500); Inpatient, Outpatient Hospital, Home Health (UB-92); and Pharmacy 
claims (NCPDP 3.0) into the State MMIS system edits. Additionally, the entry and 
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transmission of data by MO HealthNet Managed Care health plans, vendors, and 
providers, the accessibility of services, member utilization pattems, and provider 
practice pattems influence the data. With the large numberof members enrolled in 
each MO HealthNet Managed Care health plan, it was expected that factors such 
as physician practice pattems and member utilization pattems would not have a 
statistic ally significant impact on the findings, resulting in all MO HealthNet Managed 
Care health plans having similar rates of encounters per 1,000 members asthe rate 
forall MO HealthNet Managed Care health plans. Statistically significant findings 
are more likely a function of the data quality and completeness resulting from the 
processing of data by providers, vendors, MO HealthNet Managed Care health 


plans, and the MMISratherthan the accessibility or quality of services. 


Another method of examining the level, consistency, and volume of servicesis to 
compare the baseline per 1,000 member encounter data collected during the 2006 
EQRO audit to the data obtained during this audit. By comparing service levels 
received during the J uly 1, 2006 - September 30, 2006 with the service levels 
reported during the time J uly 1, 2007 - September 30, 2007, a comparison of 


accessibility to servicesand member utilization pattems can be made. 


Using the SMA encounter claims extract files from J uly 1, 2006 through September 30, 
2006, and J uly 1, 2007 through September 30, 2007 the volume of services foreach 
claim type and MO HealthNet Managed Care health plan wasexamined. The rate 
of each claim type, regardless of the accuracy, consstency, and validity of the 
data wasexamined. The rate of claims per 1,000 members based on one quarter of 
data wascalculated by dividing the number of members enrolled as of the last 
week of September for each year, by 4, then calculating the rate of claims per 
1,000 members. Figure 15 through Figure 26 illustrate the rates of claim types and 
the results of two-tailed ztests comparing each MO HealthNet Managed Care 
health plan with the statewide rate of claims. Statistically significant differences 
between an MO HealthNet Managed Care health plan and the rate forall MO 
HealthNet Managed Care health plans at the 95% level of statistical significance are 


indicated by an asterisk. The 95% upperand lower confidence limits are 
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represented by the black barson the y-axis. For comparisons that were statistically 
significant at the 95% confidence interval (Cl), the zscore (2), the upperand lower 
confidence intervals (Cl), and the significance levels (p <.05) are reported. When 
there wasno statistical significance, the significance level is reported as “not 


significant” (n.s.). 


Medical encounter claim typesconsst of claims submitted by providers, vendors, 
and MO HealthNet Managed Care health plans. 
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The results for the 2006 EQR audit were similarto those reported in 2007. In 2006, the 
rate forall MO HealthNet Managed Care health plans was 10,393.70 Medical 
encounter claims per 1,000 members (see Figure 15). In 2006, Missouri Care showed 
a significantly higher rate, while Mercy CarePlus had a significantly lower rate of 
Medical encounter claims than the rate forall MO HealthNet Managed Care health 


plans. 


For 2007, as shown in Figure 15, there wassome vanability acrossMO HealthNet 
Managed Care health plansin the statewide rate per 1,000 members of Medical 
encounter claim types compared to the rate forall MO HealthNet Managed Care 
health plans (11,184.84 Medical encounter claims per 1,000 members). One MO 
HealthNet Managed Care health plan (HealthCare USA, 13168.60, Zz = 0.833; 95% CI: 
9717.69, 16619.51; p <.01) showed a significantly higher rate, while one MO 
HealthNet Managed Care health plan (Harmony 928.49, z =-1.79; 95% Cl: -2522.42, 
4379.40; p <.01) had a significantly lower rate of Medical Encounterclaims than the 


rate forall MO HealthNet Managed Care health plans. 


Figure 15 - Medical Encounters Claim Types per 1,000 Members, J uly 1, 2006 - September 30, 2006 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 


Wiricensesi titeacantt Performance Management Solutions Group 205 
nce A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 4 


Report of Findings - 2007 Validation of Encounter Data 


Rate per 1,000 members =Number Claims] uly1-2006 - September 30, 2006 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2006 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: Missour Department of Social Services, MO HealthNet Division, State Session MPRI screen, 
enrollment for all Waivers. 

Figure 16 - Medical Encounters Claim Types per 1,000 Members, J uly 1, 2007 - September 30, 2007 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly1-2007 - September 30, 2007 / (Numbermembers/ 4) X 
1,000. Enrollment as of the last week of September 2007 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: Missoun Department of Social Services, MO HealthNet Division, State Session MPRI screen, 
enrollment for all Waivers. 


Dental encounterclaims consist of claims submitted by providers, vendors, and MO 


HealthNet Managed Care health plans. 


In 2006, as shown in Figure 17, there wassome vanability across MO HealthNet 
Managed Care health plansin the rate per 1,000 members of Dental encounter 
claims compared to the rate forall MO HealthNet Managed Care health plans 
(1696.42 Dental encounter claims per 1,000 members) submitted in 2006. Two MO 
HealthNet Managed Care health plans (Children’s Mercy Family Health Partners, 
2000.49, z = 1.20; 95% Cl: 1820.97, 2180.01; p <.05) and (Missouri Care, 1941.52, z= 
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0.96; 95% Cl: 1762.00, 2121.04; p <.05) had significantly higher rates than the 
average forall MO HealthNet health plans. While one health plan (FirstG uard, 
1332.73, Z =-1.55; 95% Cl: 1153.21, 1512.25; p <.05) had significantly lower rates of 
Dental encounter claims per 1,000 members than the rate forall MO HealthNet 


Managed Care health plans. 
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In 2007, there wasa higher rate forall MO HealthNet Managed Care health plans of 
Dental encounter claims (1569.47 Dental encounter claims per 1,000 members) than 
in 2006 (see Figure 18). One MO HealthNet Managed Care health plan (Children’s 
Mercy Family Health Partners, 1819.80, z =.84; 95% Cl: 1334.04, 2305.56538.40; p < 
.05) had a significantly higher rate. While one MO HealthNet Managed Care health 
plan (Harmony Health Plan, 000.00, z =-1.94; 95% Cl: -485.76, 485.76; p <.05 hada 
significantly lowerrate of Dental encounter claims per 1,000 members than the rate 
forall MO HealthNet Managed Care health plans. 


Figure 17 - Dental Encounters per 1,000 Members, J uly 1, 2006 - September 30, 2006 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1-2006 - September 30, 2006 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2006 was used to calculate the rate per 1,000 
members. Errorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: Missoun Department of Social Services, MO HealthNet Division, State Session MPRI screen, 
enrollment for all Waivers. 


"Seurmance manapomen Performance Management Solutions Group 208 
=< A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 4 


Report of Findings - 2007 Validation of Encounter Data 


Figure 18 - Dental Encounters per 1,000 Members, J uly 1, 2007 - September 30, 2007 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1-2007 - September 30, 2007 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2007 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: Missouri Department of Social Services, MO HealthNet Division, State Session MPRI screen, 
enrollment for all Waivers. 


In 2006, there were very few Home Health encounterclaim types submitted by MO 
HealthNet Managed Care health plans. Only two of the six MO HealthNet 
Managed Care health plans submitted Home Health encounters, see Figure 19. 
Therefore, those two health plans (FirstG uard, 39.89, z =0.63; 95% Cl: 15.88, 63.90; p < 
.05 and Blue-Advantage Plus of Kansas City, 77.07, 2 =1.78; 95% Cl: 53.06, 101.08; p < 
.05) submitted significantly higher rates of Home Health encounterclaimsthan the 
rate forall MO HealthNet Managed Care health plans (9.59 Home Health encounter 


claims per 1,000 members) . 


In 2007, again only two of the sx health plans submitted Home Health encounters, 
see Figure 20. However, only one of these health plans (BA+, 35.02, z =2.04; 95% Cl: 
24.43, 45.61; p =0.00) submitted a significantly higher rate of Home Health 


Portormance Management 
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encounter claims than the rate forall MO HealthNet Managed Care health plans 


(2.73 Home Health encounter claims per 1,000 members). 
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Figure 19 - Home Health Encounter Claim Types per 1,000 Members, , J uly 1, 2006 - September 30, 2006 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1-2006 - September 30, 2006 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2006 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 


Source: MO Dept of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers. 


Figure 20 - Home Health Encounter Claim Types per 1,000 Members, J uly 1, 2007 - September 30, 2007 
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Note: Rate per 1,000 membersis an estimated annual rate based on first quarter state encounter data; 

Rate per 1,000 members =Number Claims] uly 1-2007 - September 30, 2007 / (Number members/ 4) X 
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1,000. Enrollment as of the last week of September 2007 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: MO Dept of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers 
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Inpatient encounter claim types consist of claims submitted by hospital facilities and 
MO HealthNet Managed Care health plans. Asshown in Figure 21, in 2006, there 
wassome variability acrossMO HealthNet Managed Care health plansin the rate 
per 1,000 membess of Inpatient encounter claims compared to the rate forall MO 
HealthNet Managed Care health plans (1118.99 Inpatient encounter claims per 
1,000 members). One MO HealthNet Managed Care health plan had signific antly 
higher rates of Inpatient encounter claims (Missoun Care, 1933.40, z =1.25; 95% Cl: 
1411.47, 2455.33, p <.01). Two MO HealthNet Managed Care health planshad 
significantly lower rates of Inpatient encounter claims (MercyCare Plus, 164.43, z =- 
1.26; 95% Cl: -357.50, 686.36; p <.01; Blue-Advantage Plus of Kansas City, 272.06, z =- 
1.11; 95% Cl: -249.87, 793.99; p <.01) than the rate forall MO HealthNet Managed 
Care health plans. 


In 2007, the EQRO found that two MO HealthNet Managed Care health planshad 
significantly lower rates of Inpatient encounter claims (Harmony, 0.00, z =-1.36; 95% 
Cl: -558.98, 558.98; p <.01; MercyCare Plus, 157.47, z =-1.15; 95% CI: -401.51, 716.45; 
p <.01). One health plan had a sgnificantly higher rate of Inpatient encounter 

claims (BlueAdvantage Plus of Kansas City, 1755.65, z =0.97; 95% Cl: 1196.67, 
2314.63; p <.05) compared to the rate forall MO HealthNet Managed Care health 
plans. 
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Figure 21 - Inpatient Encounter Claim Types per 1,000 Members, J uly 1, 2006 - September 30, 2006 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; Rate per 
1,000 members =Number Claims] uly1-2006 - September 30, 2006 / (Number members/ 4) X 1,000. Enrollment as of 
the last week of September 2006 was used to calculate the rate per 1,000 members. Erorbarson the y-axis 
represent 95% confidence intervals; * Indicates valuesare significant at the 95% level of significance, two-tailed z 
test. 


Source: Missour Department of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers. 


Figure 22 - Inpatient Encounter Claim Types per 1,000 Members, J uly 1, 2007- September 30, 2007 
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Note: Rate per1,000 membersisan estimated annual rate based on first quarter state encounter data; Rate per 

1,000 members =Number Claims] uly1-2007 - September 30, 2007 / (Number members/ 4) X 1,000. Enrollment as of 
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the last week of September 2007 was used to calculate the rate per 1,000 members. Emorbarson the y-axis 
represent 95% confidence intervals; * Indicates values are significant at the 95% level of significance, two-tailed z- 
test. 

Source: Missourn Department of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers. 


Outpatient Hospital encounter claim types consist of claims submitted by outpatient 
hospital facilities and MO HealthNet Managed Care health plans. As shown in 
Figure 23, in 2006, there wassome vaniability acrossMO HealthNet Managed Care 
health planscompared to the rate forall MO HealthNet Managed Care health 
plans (5,764.67 Outpatient Hospital encounter claims per 1,000 members). Two MO 
HealthNet Managed Care health planshad significantly higher rates of Inpatient 
encounter claims (Missoun Care, 9539.88, z =1.44; 95% Cl: 7857.40, 11222.36; p <.05; 
Family Health Partners, 8403.17, z =0.93; 95% Cl: 6720.69, 10085.65; p <.05). While 
one MO HealthNet Managed Care health plan had significantly lower rates of 
Outpatient Hospital encounter claims per 1,000 members (Merc yCare Plus, 3439.30, 
Z =-1.25; 95% Cl: 1756.82, 5121.78; p <.05) than the rate forall MO HealthNet 
Managed Care health plans. 


In 2007 (see Figure 24), the EQRO found that the rate of Outpatient Hospital 
encounter claims per 1,000 members for all MO HealthNet Managed Care health 
plans was 5,547.72. The EQRO found that one MO HealthNet Managed Care health 
plan had a significantly higher rate of Outpatient Hospital encounter claims (Missouri 
Care, 8785.34, Z =1.21; 95% Cl: 6530.31, 11040.37; p <.01). While one MO HealthNet 
Managed Care health plan had a sgnificantly lower rate of Outpatient Hospital 
encounter claims per 1,000 members (Harmony Health Plan, 3.43, Z =-1.67; 95% CI: - 
2251.60, 2258.46; p <.01) than the rate forall MO HealthNet Managed Care health 


plans. 
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Figure 23 - Outpatient Hospital Encounter Claim Types per 1,000 Members, J uly 1, 2006 - Sept 30, 2006 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter 
data; Rate per 1,000 members = Number Claims] uly 1, 2006 - September 30, 2006 / (Number 
members/ 4) X 1,000. Enrollment as of the last week of September 2006 was used to calculate the 
rate per 1,000 members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values 
are significant at the 95% level of significance, two-tailed ztest. 


Source: MO Dept of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers. 
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Figure 24 - Outpatient Hospital Encounter Claim Types per 1,000 Members, J uly 1, 2007 - Sept. 30, 2007 
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Note: Rate per 1,000 membersis an estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1, 2007 - September 30, 2007 / (Number members/ 4) X 
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1,000. Enrollment as of the last week of September 2007 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: MO Dept of Social Services, MO HealthNet Division, State Session MPRI screen, enrollment for all 
Waivers. 

Pharmacy encounter claim types consist of claims submitted by pharmacy providers 


and MO HealthNet Managed Care health plans. In 2006, as shown in Figure 25, 
there waslittle variability acrossMO HealthNet Managed Care health plans in the 
statewide rate per 1,000 members of Pharmacy encounter claims compared to the 
rate forall MO HealthNet Managed Care health plans (5487.94 Pharmacy 
encounter claims per 1,000 members). In thiscategory, one MO HealthNet 
Managed Care health plan (MercyCare Plus, 3749.62; z =-1.73; 95% Cl: 2717.34, 
4781.90; p <.05) had a significantly lowerrate of Pharmacy encounterclaims. The 
other fourMO HealthNet Managed Care health planshad a rate consistent with the 
rate forall MO HealthNet Managed Care health plans. This “all MO HealthNet 
Managed Care health plan” rate doesnot include pharmacy encounters for the 
MO HealthNet Managed Care health plan, Children’s Mercy Family Health Partners, 
this is due to the fact that CMFHP “carved - out” pharmacy encounters from their 
contract with the SMA beginning on J uly 1, 2006. 


In 2007, asshown in Figure 26, there was wide variability across MO HealthNet 
Managed Care health plansin the rate per 1,000 members of Pharmacy encounter 
Claims compared to the rate forall health plans. Missouri Care (7748.92, z =1.09, 
95% Cl: 5267.69, 10230.15; p <.01) had a significantly higher rate of Pharmacy 
encounter claims, see Figure 31. While two MO HealthNet Managed Care health 
plans (Children’s Mercy Family Health Partners, 2.49, z =-1.22; 95% CI: -2478.74, 
2481.23; p <.01; and Harmony Health Plan, 0.00, z =-1.22; 95% Cl: -2481.23, 2481.23; 
p <.01) had a significantly lower rate of Pharmacy encounter claims per 1,000 


members than the rate forall MO HealthNet Managed Care health plans. 
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Figure 25 - Pharmacy Encounter Claim Types per 1,000 Members, J uly 1, 2006 - September 30, 2006 
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Note: Rate per 1,000 membersis an estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1, 2006 - September 30, 2006 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2006 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 

Source: MO Dept of Social Services, Division of Medical Services, State Session MPRI screen, enrollment 
forall Waivers. 


Figure 26 - Pharmacy Encounter Claim Types per 1,000 Members, J uly 1, 2007 - September 30, 2007 
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Note: Rate per 1,000 membersisan estimated annual rate based on first quarter state encounter data; 
Rate per 1,000 members =Number Claims] uly 1, 2007 - September 30, 2007 / (Number members/ 4) X 
1,000. Enrollment as of the last week of September 2007 was used to calculate the rate per 1,000 
members. Erorbarson the y-axis represent 95% confidence intervals; * Indicates values are significant 
at the 95% level of significance, two-tailed z-test. 
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Source: MO Dept of Social Services, MO HealthNet Division, State Session MPRI screen, enrollment for all 
Waivers. 


Table 36 and Figure 27 show the proportion of claim types foreach MO HealthNet 
MCO based onthe SMA encounter claims extract file. HealthCare USA had the 
highest proportion of Medical claims relative to all other MO HealthNet MCOs; 
Children’s Mercy Family Health Partners had the highest proportion of the Dental 
claim types; Blue-Advantage Plus of Kansas City had the highest proportion of Home 
Health and Inpatient claim types; and Missoun Care had the highest proportion of 
Hospitaland Pharmacy claims. There were no pattems observed across MO 
HealthNet Plans, suggesting that the vanations are not related to memberor 


provider practice charactenstics. 


In 2006, Missouri Care had the highest proportion of Medical, Hospital and Inpatient 
claims; HealthCare USA had the highest proportion of Pharmacy claims; Blue- 
Advantage Plus of Kansas City again had the highest proportion of Home Health 
claims; and Children’s Mercy Family Health Partners again had the highest 
proportion of Dental claims relative to all other MO HealthNet Managed Care 


health plans (see Table 37 and Figure 28). 


Table 36 - Numerical Proportion of Claim Types per MC + MCO, J uly 1, 2006 -September 30, 2006 


Home 
° Health ° 


MCP 8082.78 1597.66 164.43 0.00 3439.30 3749.62 
HCUSA 10531.53 = 1692.93 1512.30 0.00 5581.21 7108.36 
MOCare 13498.00 1941.52 1933.40 0.00 9539.88 7039.66 
FHP 10686.30 2000.49 1363.49 0.00 8403.17 0.00 
FG 9636.20 1332.73 1057.67 39.89 5804.31 6688.69 


12900.88 1690.32 272.06 77.07 4912.01 6224.97 


BA+ 
All MC+ MCOs | 10393.70 | 1696.42 1118.99 5764.67 5487.94 
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Figure 27 - Percentage Proportion of Claim Types per MC + MCO, J uly 1, 2006 - September 30, 2006 
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O Inpatient 164.43 1512.30 1933.40 1363.49 1057.67 272.06 Ate 99 

@ Medical 8082.78 10531.53 13498.00 10686.30 9636.20 12900.88 10393.70 

@ Home Health 0.00 0.00 0.00 0.00 39.89 77.07 259 

@ Hospital 3439.30 5581.21 9539.88 8403.17 5804.31 4912.01 5764.67 

@ Dental 1597.66 1692.93 1941.52 2000.49 1332.73 1690.32 1696.42 

@ Pharmacy 3749.62 7108.36 7039.66 6.36 6688.69 6224.97 5487.94 
MC+ MCO 




















Source: Missouri Department of Social Services, Division of Medical Services encounter claims extract 
file, February15, 2007. 


Table 37 - Numerical Proportion of Claim Types per MO HealthNet Managed Care health plan, J uly 1, 


2007 - September 30, 2007 
rece Merson cai nereartl Mepecerellt escran’|ineecnan! enernacedl 
MCHP p Health ° 
MCP 





7139.39 1380.50 157.47 0.00 3528.36 4362.48 

HCUSA 13168.60 1710.41 1500.27 0.09 5683.35 6624.19 
MOCare 11803.08 1438.73 1531.42 0.00 8785.34 7748.92 
CMFHP 9897.51 1819.80 1190.37 0.00 7056.60 2.49 
a 928.49 0.00 0.00 0.00 3.43 0.00 
12787.18 1274.52 1755.65 35.02 5467.79 5754.59 


PATIEHEER 11184.04 | 1569.47 1188.75 2.73 5547.72 PEER 
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Figure 28 - Percentage Proportion of Claim Types per MO HealthNet Managed Care health plan, J uly 1, 
2007 - September 30, 2007 
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40% 
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0% + 
MCP HCUSA MOCare CMFHP Harmony BA+ All MCHPs 
O Inpatient 157.47 1500.27 1531.42 1190.37 0.00 1755.65 1188.75 
@ Medical 7139.39 13168.60 11803.08 9897.51 928.49 12787.18 11184.04 
Home Health 0.00 0.09 0.00 0.00 0.00 35.02 Zales 
B Hospital 3528.36 5683.35 8785.34 7056.60 3.43 5467.79 5547.72 
B Dental 1380.50 1710.41 1438.73 1819.80 0.00 1274.52 1569.47 
@ Pharmacy 4362.48 6624.19 7748.92 2.49 0.00 5754.59 5233.40 
MC+ MCO 


Source: Missouri Department of Social Services, MO HealthNet Division encounter claims extract file, 
February15, 2008. 


Table 38 - MO HealthNet MC Os, Rate per 1,000 Members all Encounter Claims 




















Claims Per 
Number of Total 1000 
Claim Type Claims Members Members 

Home Health 235 343,998 0.68 
Dental 134,974 343,998 392.37 
Medical 961,822 343,998 2,796.01 
Outpatient 477,101 343,998 1,386.93 
Drug 450,070 343,998 1,308.35 
Inpatient 102,232 343,998 297.19 




















Note: Rate per 1,000 membersisan estimated annual rate based on third quarter tate encounter 
data; Rate per 1,000 members = Number Claims] uly 1, 2007 - September 30, 2007 / (Number 
members) X 1,000. Enrollment as of the last week of September 2007 was used to calculate the rate 
per 1,000 members. Source: Missour Department of Social Services, MO HealthNet Division encounter 
claims extract file. 
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To What Extent do the MO HealthNet MC HP claims (paid and unpaid) match the 
State Encounter Claims Paid Claims Data Base? 


All six MO HealthNet Managed Care health plans submitted the requested intemal 
control numbers (IC Ns) generated by the SMA data system forthe “paid” vs. 
“unpaid” analysis. Health Care US, Missoun Care, Children’s Mercy Family Health 
Partners, Blue-Advantage Plus of Kansas City, and Harmony Health Plan of Missouri 
submitted encounter claims that were “paid” or “denied” status. Harmony Health 
Plan, Missoun Care and Blue-Advantage Plus of Kansas City also submitted claims 


with a status of “unpaid”. 


The IC Ns were used to match the encounters of each claim type (Inpatient, 
Outpatient, and Pharmacy) between the MO HealthNet Managed Care health 
plan and the SMA extract files. A “match” wasconsidered if the MO HealthNet 


Managed Care health plan sample encounter was identified in the SMA database. 


What types of paid encounter data are missing and why? 
There were no unmatched “paid” encounters within all claim types (Inpatient, 


Outpatient, and Pharmacy) forall MO HealthNet Managed Care health plans. 


ForallMO HealthNet Managed Care health plans, all unmatched encounters were 
due to missing ICN numbers, which are required to match the encounter to that of 
the SMA. There were no unmatched encounters within the Pharmacy Claim type. 
Forthe Outpatient data, 100.00% of the 535 unmatched claims were missing ICN 
numbers. Of the 535 unmatched claims, 424 of those were of “denied” status and 
would not be expected to be present in the SMA file. For Inpatient Claims, all 299 
unmatched claims were missing ICNs. Therefore, all were legitimately missing from 
the SMA file. 
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What is the fault/ match rate of paid and unpaid encounter claims in the SMA 
encounter claim database and the MO HealthNet MC HP claims database? 


Forall Outpatient Claim Types (Medical, Dental, Home Health, & Hospital; n = 
1,574,132), 481 “denied” claims were submitted by all MO HealthNet Managed Care 
health plans. Allof these claims were unmatched with the SMA encounter data. 
There wasa “hit” rate of 99.96% between Outpatient encounter claims and the SMA 
encounter data. Forthe Inpatient Claim Type, data submitted to the EQRO (n = 
102,232), 332 “denied” claims were submitted. These claims were not found in the 
SMA encounterdata. There were a total of 223 unmatched records (6 “unpaid” 
claims were submitted) between all MO HealthNet MCOsand the SMA, yielding a 
99.94% “hit” rate. 


What services are being provided that are not being paid and how many services 
are being provided that are not being paid? 


Unpaid encounterclaims were submitted for only Outpatient and Inpatient 
categories. 6 unpaid claims were submitted forall MO HealthNet MCOs forall 
Outpatient claimsand Inpatient services. These unpaid claims represent less than 
.01% of all claims submitted to the SMA. 
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To What Extent Do the Claims in the State Encounter Claims Database Reflect the 
Information Doc umented in the Medical Record? Whatis the Fault/ Match Rate 
between State Encounter Claims and Medical Records? 


Table 39 shows the population (number of encounters), minimum required sample 
size, the numberof encounters sampled, and the numberand rate of records 
submitted forreview. Of the 2,126,434 encounter claim types in the SMA encounter 
Claims extract file forJ uly 1, 2007 through September 30, 2007, 600 encounters (100 
per MO HealthNet Managed Care health plan) were randomly selected. Thiswas 
an oversample, asthe minimum required sample size was 88 per MO HealthNet 
Managed Care health plan. Providers were requested to submit medical records 
forreview. Forthe 600 selected encounters, there were 561 medical records 
(93.50%) sub mitted for review. Although this isa substantial increase overthe 86.71% 
submitted for review during the 2005 audit, itwasa decrease from the 97.40% 
submitted forthe 2006 audit. For 2007, MO HealthNet Managed Care health plan 
submission rates ranged from 88.0% (Children’s Mercy Family Health Partners) to 
98.0% (Missouri Care). Encounters for which no documentation was submitted were 
unable to be validated. Table 40 and Figure 29 show the results of the match for 
procedures. Acrossall MO HealthNet MC Os, 52.00% of the medical records 
contained matching procedure codesordescnriptors; this isa decrease of 21.24% 
from the 2006 audit which found 73.24% of the medical recordscontained matching 
procedure codesor descriptors. MO HealthNet Managed Care health plan match 
rates ranged from 45.0% (Harmony Health Plan) to 58.0% (Missouri Care). One MO 
HealthNet Managed Care health plan (Missouri Care, 58.0%; z = 1.69, 95% Cl: 54.86, 
61.14; p <.05) had match rates significantly higher than the rate forall MO 
HealthNet Managed Care health plans. The remaining five MO HealthNet Managed 
Care health planshad match rates consistent with the rate forall MO HealthNet 
MCOs. The CMS Protocols suggest a 99% match rate asa validity criterion. When 
considering only the documentation submitted for review, the match rate forall MO 


HealthNet Managed Care health plans for procedures was 55.61% 
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Table 39 - Encounter Data Validation Samples and Medical Record Submission Rate 





Number 

Minimum Number Medical 
Number Sample Encounters Records Submission 

MO HealthNet MCHP Encounters Size Sampled Received Rate 

MercyCare Plus 280,189 88 100 94 94.00% 
Health Care USA 1,235,187 88 100 93 93.00% 
Missouri Care 214,472 88 100 98 98.00% 
Family Health Partners 216,345 88 100 88 88.00% 
Blue-Advantage Plus 178,612 88 100 97 97.00% 
Harmony Health Plan 1,629 88 100 91 91.00% 


Note: The number of encounters represents the number of unique Medical claim types found in the 
SMA encounterclaims extract file forthe period J uly 1, 2007 through September 30, 2007. The minimum 
sample size isbased on the validation of medical records fortwo dependent variables, the procedure 
code and the diagnosiscode. Number Encounters Sampled =Number of unique encounters randomly 
sampled by the EQRO for medical record review validation. Number Medical Records Received = 
Number medical records submitted by MO HealthNet Managed Care health plan providers; Number 
Claim Forms Received =Number claim forms submitted by MO HealthNet MCHP providers; Submission 
Rate =Proportion of medical records submitted of the number of encounters sampled. 

Source: Missouri Department of Social Services, Division of Medical Services encounter claims extract 
file, January 2008. 

BHC, Inc. 2007 Extemal Quality Review Validation of Encounter Data. 
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Table 40 - Procedure Validation Rate 
Rate Validated 
of Medical 
Records 
Received 


Number 

Medical 

Records 
Received 


Number 
Encounters 
Sampled 


Number 
NEVI Ce Fh a-ve| 


MO HealthNet MCHPs 





MercyCare Plus 100 94 54 57.45% 
Health Care USA 100 93 52 55.91% 
Missouri Care 100 98 58 59.18% 
Family Health Partners 100 88 oy] 57.95% 
Blue Advantage Plus ma a 7 53.61% 
Harmony Health Plan 49.45% 


Actual 
WEVIT ER ateya] 
Rate 
54.00% 
52.00% 
58.00% 
51.00% 
52.00% 
45.00% 


46.00% 
48.00% 
42.00% 
49.00% 
48.00% 
55.00% 


Validation of Encounter Data 


Lo on icles 


1.2838251 0.284 50.86% 57.14% 
0.9225336 0.853 48.86% 55.14% 
1.6932081 0.038 54.86% 61.14% 
1.4034998 0.173 47.86% 54.14% 
0.3790676 7 sam 48.86% 55.14% 
-0.6009113 41.86% 48.14% 


za Ty ae 55.61% 52.00%| 48.00%) 0.8520574 5 08 48.86%] 55.14% 


Note: Number Encounters Sampled =Number of unique encounters randomly sampled by the EQRO for medical record review validation; 
Number Medical Records Received =Number medical records submitted by MO HealthNet Managed Care health plan providers for validation; 
Number Validated =Number of encounters for which there wasa similaror matching procedure code ordescription on the claim form, or 
adequate documentation in the medical record to support the procedure code as judged by a professional medical coder. Rate Validated of 
Medical Records Received =Number Validated/Number Medical Records Received; Actual Rate Validated =Number Validated/Number 

Enc ounters Sampled; LCL =Lower Confidence Limit at the 95% confidence level; UCL =Upper Confidence Limit at the 95% confidence level. 
Source: Missouri Department of Social Services, Division of MO HealthNet encounter claims extract file, January 2008. 


BHC, Inc. 2007 Extemal Quality Review Validation of Encounter Data. 
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Figure 29 - Encounter Data Procedure Validation Rate, J uly 1, 2007 - September 30, 2007 





Encounter Data Procedure Validation Rate 
July 1, 2007 - September 30, 2007 





Actual Validation Rate 





MercyCare Plus Health Care USA Missouri Care Family Health Blue Advantage HarmonyHealth All MOHealthNet 
Partners Plus Plan MCHPs 


MO HealthNet MCHPs 


DActual Validation Rate 54.0% 52.0% an oad e280 oot pes 











Note: * Indicates values are significant at the 95% level of significance, two-tailed ztest. See 
corresponding tables for 95% confidence intervals. 

Source: Missouri Department of Social Services, Division of Medical Services encounter claims 
extract file, January 15, 2008. BHC, Inc. 2007 Extemal Quality Review Validation of Encounter Data. 


For the validation of the diagnoss, 47.0% matched the diagnosis found in the 
SMA encounterclaims extract file across all MO HealthNet Managed Care 
health plans (see Table 41 and Figure ). Thiswasa significant decrease from the 
2006 audit when the EQRO found that 70.56% matched the diagnosis found in 
the SMA encounter claims extract file. For the 2007 audit, MO HealthNet 
Managed Care health plan match rates ranged from 36.0% (Harmony Health 
Plan) to 60.0% (Missoun Care) of the medical recordsorclaim forms for diagnosis 
codes. Two MO HealthNet Managed Care health plans (Missoun Care, 60.0%, z 
=1.38, 95% Cl: 51.73, 68.27; p<Oland Blue-Advantage Plus of Kansas City, 59.0%, 
Z =1.34, 95% Cl: 50.73, 67.27; p<01) had match rates significantly higher than the 
rate forall MO HealthNet Managed Care health plans; while two MO HealthNet 
Managed Care health plans (Harmony Health Plan, 36.0%, z =-.72, 95% Cl: 27.73, 
44.27; p <.01 and HealthCare USA, 39.0%, z =-.49, 95% Cl: 30.73, 47.27; p <.01) 
had a significantly lower rate. The CMS Protocol suggestsa greater than 90% 
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validity criterion.1” No MO HealthNet Managed Care health plan met that 
validity criterion. 





17 Validating Encounter Data, A protocol for use in Conducting Medicaid External Quality Review Activities, 
Department of Health and Human Services, Centers for Medicare and Medicaid Services, Final Protocol, 
Version 1.0, May 1, 2002. 
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Table 41 - Encounter Data Diagnosis Validation Rate- J uly 1, 2007 - September 30, 2007 
Rate 
Validated 
Number of 
Number Medical Medical Actual Error 
Encounters | Records Number LX=Yele] ge fy NEVI CoE La lela) (Fault) 
_MCHP SS PS id 1! d Rate 
re IS 





Pp ice ce 
MercyCare Plus | cemh aa 0.125 32.73% 49.27% 


98 OCG 1.22% 60.00% 40.00% | 1.3764203 0.008 51.73% | 68.27% 
Blue Advantage Plus 60.82% 59.00% 41.00% | 1.3377391 0.011 50.73% | 67.27% 
rey, i RO oF BO é 6400 n 2 i } y A 27% 


All MCHPs 561 282 50.27% 47.00% 53.00% 0.3161651 0.967 38.73% 55.27% 


Note: Number Encounters Sampled =Number of unique encounters randomly sampled by the EQRO for medical record review validation; Number 
Medical Records Received =Number medical records submitted by Health Plan providers for validation; Number Validated =Number of encounters 
for which there wasa matching diagnosis code, documentation ordescription in the medical record oron the claim form. Rate Validated of 
Medical Records Received =Number Validated/Number Medical Records Received; Actual Rate Validated =Number Validated/Number 

Enc ounters Sampled; LCL =Lower Confidence Limit at the 95% confidence level; UCL =Upper Confidence Limit at the 95% confidence level. 
Source: Missour Department of Social Services, Division of Medical Services encounter claims extract file, December 15, 2007. 

BHC, Inc. 2007 Extemal Quality Review Validation of Encounter Data. 


A division of Behavioral Health Concepts, Inc. 
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Figure 30 - Encounter Data Diagnosis Validation Rate- J uly 1, 2007- September 30, 2007 
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OD Actual Validation Rate 41.0% 39.0% 60.0% 47.0% 59.0% 36.0% 47.0% 











Note: Encounters Sampled =Number of unique encounters randomly sampled by the EQRO for 
medical record review validation; Number Medical Records Received =Number medical records 
submitted by Health Plan providers for validation; Number Validated =Number of encounters for 
which there wasa matching diagnosiscode, documentation ordescription in the medical record 
oron the claim form. Rate Validated of Medical Records Received =Number Validated/Number 
Medical Records Received; Actual Rate Validated =Number Validated/Number Encounters 
Sampled; LCL =Lower Confidence Limit at the 95% confidence level; UCL=Upper Confidence 
Limit at the 95% confidence level. 

Source: Missouri Department of Social Services, MO HealthNet Division encounter claims extract 
file, January 15, 2008. BHC, Inc. 2007 Extemal Quality Review Validation of Encounter Data. 


What Types of Errors Were Noted? 

An enor analysis for procedure and diagnosis codes wasconducted. Forthe 
diagnosis code in the medical record, the reasons for diagnosis codesnot 
matching the SMA encounter claims extract file were incorrect information (n = 
28) and missing information (n =251). Incorrect information included that the 
diagnosis code listed did not match the descriptive information in the record. 
Missing information included the coders being unable to find a diagnosiscode or 


diagnosis description in the medical records received for review. 
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Forthe procedure code in the medical record, the reasons for procedure codes 
in the SMA encounter claims extract file not being supported by documentation 
in the medical record were missing information (n =198), upcoding (n=18), 
downcoding (n=/) and incorect codes(n =26). Examplesof incorrect 
information included: incomect codes (n =20) and codes that did not match 


the procedure description (n =6). 


What Problems Are There With How Files Are Compiled and Submitted by the 
MC HP? 


The EQRO had no problems with how filesare compiled and submitted by each 
MO HealthNet Managed Care health plan. 


What Are the Data Quality Issues Associated With the Processing of Enc ounter 
Data? 


The EQRO had no data quality issues with SMA and MO HealthNet Managed 
Care health plan encounter data during the course of conducting the EQRO. 
This was only the second year of the EQR that the EQRO hasreceived all 


encounter data in the format requested. 


4.5 Conclusions 
STRENGTHS 
1. AllDental and Pharmacy claim type fields examined were 100.00% 
complete, accurate and valid forall MO HealthNet Managed Care 
health plans. The SMA encounterclaims data critical fields examined for 
accepted and paid claims of thistype are valid for analysis. 
2. ForallMO HealthNet Managed Care health plans, the first Outpatient 
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Diagnosis Code field was 100.0% complete, accurate and valid. 

3. All MO HealthNet Managed Care health plans submitted data in the 
format requested, and the EQRO wasable to perfom the analysis of paid 
and unpaid claims contained in the SMA database. 

4. The examination of the level, volume, and consistency of services found 
significant variability between MO HealthNet Managed Care health plans 
in the rate of each type of claim (Medical, Dental, Inpatient, Outpatient 
Hospital, Home Health, and Pharmacy), with no pattemsof variation 
noted by Region ortype of MO HealthNet Managed Care health plan. 

5. MO HealthNet Managed Care health plan membersare receiving more 
services than their fee-for-servicescounterparts. The claimsdata 
presented detailsa much higher rate of claims per 1,000 members for MO 
HealthNet Managed Care members. Thisis likely due to a greater 
availability of needed services, more access points to care, and the 
timeliness in which those services are delivered. 

6. MO HealthNet Managed Care health plan members received a 
substantia lly larger portion of all Outpatient services delivered in Missoun 
during the 2007 measurement penod versus the 2006 measurement 
period. 

7. There were no unmatched “paid” encounters within all claim types 
(Inpatient, Outpatient, and Pharmacy) forall Managed Care health 
plans. 


8. Unpaid claims represent less than .01% of all claims submitted to the SMA. 


AREAS FOR IMPROVEMENT 
1. ForallMO HealthNet Managed Care health plans, all unmatched 
encounters were due to missing ICN numbers, which are required to 
match the encounter to that of the SMA. 
2. The Procedure Code field in the Outpatient Home Health and Outpatient 
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2. 


4. 


D: 


Hospital claim typesincluded some invalid information. Most of thiswas 
due to blank fields or fields containing “00000”. 

The Inpatient first diagnosis claim field contained incomplete, invalid, and 
inaccurate fields. 

The match rates between the SMA database and MO HealthNet 
Managed Care health plan medical records forclaim type procedures 
were 52.0%, a significant decrease from last years match rate of 73.24% 
Medical records that did not have procedure codes that matched the 
SMA encounterclaims extract file were in eror primarily due to missing or 
incorrect information. 

The match rates between the SMA database and MO HealthNet 
Managed Care health plan medical records for claim type diagnoses 
were 47.0%, this is significantly lower than last year’s match rate of 70.56%. 
Medical records that did not have procedure codes that matched the 
SMA encounterclaims extract file were in enor primarily due to missing or 


incorrect information. 


RECOMMENDATIONS 


i; 


2: 


It isrecommended that the SMA institute additional edits for the Medical, 
Inpatient and Outpatient Hospital claim types to edit claims with blank 
fields or dummy values (e.g., “000” and “99999999”. 

The SMA should continue to provide timely feedback to MO HealthNet 
Managed Care health plans regarding the rate of acceptance of each 
claim type and the types of enors associated with rejected claims. 
Additional analysis on the rate of consistency of services should examine 
demographic (e.g., age and gender distribution), epidemiological 
(diagnostic variables), and service delivery (e.g., number of users per 
month, rate of proceduresorclaim types, units of service rates) 


characteristics to explain variation acrossMO HealthNet Managed Care 
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health plans or Regions. 

4. MO HealthNet Managed Care health plans’ medical record reviews 
should be targeted toward validation of diagnosis and procedure codes 
and/ordescriptors. 

5. The SMA should clarify the expectations forMO HealthNet Managed Care 
health plans in the level of completeness, accuracy, and validity and 
which data fields are required (e.g., Diagnosis Code fields 2 through 5); 
provide timely feedback to MO HealthNet Managed Care health plans 
when standards are not met; and develop corrective action plans when 
standards are not met within a reasonable amount of time established by 
the SMA. 

6. The MCHP should investigate and report to the SMA the reasons for and 
corrective action to prevent the substantial decline in medical records 
matches for both diagnosesand procedures between the 2006 and 2007 
EQR reports. 
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5.1 Purpose and Objectives 


The Extemal Quality Review (EQR) isconducted annually in accordance with the 
Medicaid Program: Extemal Quality Review of the Medicaid Managed Care 
Organizations Final Rule, 42 CFR 438, Subpart E.” The orginal objective of this 
portion of the 2004 review wasto analyze and evaluate the MO HealthNet 
Managed Care health plansto assess their level of compliance with federal 
regulations regarding quality, timelinessand accessto health care services. In 
the two subsequent years, beginning in 2005 and culminating in 2006, the 
objective is to complete follow-up reviewsto ensure improved and continued 
compliance with these regulations on the part of the MO HealthNet MCHPs. To 
complete this process, the Monitoring Medicaid Managed Care Organizations 
(MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A Protocol for Determining 


Compliance with Medicaid Managed Care Regulations (Compliance Protocol) 





requirements was applied to the review process, with an emphasis on areas 
where individual MCHPs failed to comply or were in only partial compliance at 
the time of the prnorreviews. Specifically, the MCHPs were reviewed to assess 
MO HealthNet MCHP compliance with the federal Medicaid managed care 
regulations; with the State Quality Strategy; with the MO HealthNet contract 
requirements; and the progress made in achieving quality, access, and 
timeliness to services from the previous review year. To enhance this processin 
2006 two additional activitiesoccured. A case review of Gnevance and 
Appeal files, following up on findings from 2004 and 2005, wascompleted. A 
second case review focusing on Behavioral Health Case Management files, a 


follow-up from the 2003 Extemal Quality Review occured. 


The current 2007 report on compliance with federal regulationsis again a full 
compliance review. However, as previous reviews revealed the MO HealthNet 
Managed Care health plans have neany reached full compliance with 


completing written policy and procedures that meet both the requirements of 
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the federal regulations and the MO HealthNet Division (MHD), which is the State 
agency administering the federal Medicaid program (SMA). To enhance the 
review it wasdecided to complete in-depth interviews with Member Services 
Staff, Case Management Staff, and health plan administrators. The Member 
Services Staff and Case Managershave direct contact with members and are 
responsible for communicating the servicesavailable to members, members’ 
rights and responsibilities, and ensuring that members have appropriate access 
to quality and timely health care. These interviews were designed to validate 
that the actual practices occumning at the MO HealthNet Managed Care health 
plans were compliant with the written policy and procedures developed by the 


health plansand approved by the SMA. 


5.2 Technical Methods 


PLANNING COMPLIANCE MONITORING ACTIVITIES 

Establishing Contact with the MO HealthNet MCOs 

All MO HealthNet Managed Care health plans were contacted during 
November 2007 to prepare them for the 2007 Extemal Quality Review. All MO 
HealthNet Managed Care health plan quality management staff and/or plan 
administrators were contacted to discuss the onset of Extemal Quality Review 
Organization (EQRO) activitiesand to schedule training teleconferences for early 
December. The MCHPs were explicitly requested to have those staff or 
subcontractors available who were responsible for obtaining and submitting the 
data required to complete all validation processes. During the teleconferences, 
all aspects of the EQR were discussed and details provided regarding alldata 


submissions that would be required. 


The training teleconference agenda, methodsand objectives, and schedule 


were sent to all MO HealthNet Managed Care health plans, with approval from 
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the State Medicaid Agency (SMA), priorto theirscheduled conference. SMA 
staff arranged to participate in these conference calls allowing time for 


presentation of information, clarification, and questions. 


Gathering Information on the MO HealthNet MC HP Characteristics 

During the 2007 review yearthere were six MO HealthNet Managed Care health 
plans contracted with the State Medicaid Agency (SMA) to provide MO 
HealthNet Managed Care in three Regions of Missoun. The Eastem Region 
includes St. Louis City, St. Louis County, and eight surrounding counties. These 
MO HealthNet Membersare served by three MO HealthNet Managed Care 
health plans: Mercy CarePlus (MCP), HealthCare USA (HCUSA), and Harmony 
Health Plan of Missour (HHP). The Westem includes Kansas City/J ackson County 
and eight surrounding counties. These MO HealthNet membersare served by 
fourMO HealthNet Managed Care health plans: Children’s Mercy Family Health 
Partners (CMFHP), Blue-Advantage Plus (BA+), Mercy CarePlus (MCP), and 
HealthCare USA (HCUSA). The Central Region includes eighteen counties in the 
center of the state. These MO HealthNet members are served by three MO 
HealthNet Managed Care health plans: Missour, Care (MOCare), Mercy 
CarePlus (MCP), and HealthCare USA (HCUSA). Mercy CarePlus and HealthCare 


USA operated in all three Regions. 


Detemnnining the Length of Visitand Dates 

On-site compliance reviews were conducted in two daysat each MO HealthNet 
Managed Care health plan, with several reviewers conducting interviews and 
activities concurrently. Document reviews occured priorto the complete on-site 
review at all MO HealthNet Managed Care health plans, with the exception of 
Harmony Health Plan of Missouri. All review activities were completed ina one 
day visit at Harmony Health Plan who accommodated the document review 
activities by preparing information for reviewers to take with them for completion 


after the date of the actual on-site visit. Interviews, presentations, and additional 
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document reviews were scheduled throughout the day, utilizing different team 
members for Validating Performance Measures, Validating Performance 
Improvement Projects, Monitoring Medicaid Managed Care Organizations 
(MCHPs) and Prepaid Inpatient Health Plans (PIHPs). The time frames for on-site 
reviews were determined by the EQRO and approved by the SMA before 
scheduling each MO HealthNet Managed Care health plan. The first week was 
spent reviewing the MO HealthNet Managed Care health plansin the Eastem 
Region. The second review week was spent in the Central Region. The final visits 
occured with the health plansin the Westem Region. The following schedule 
lists the dates of the on-site reviews: 

e July 7&8, 2008 - Mercy CarePlus 

e July 7&9, 2008 - HealthCare USA 

e July 10, 2008 - Harmony Health Plan 

e July 15& 16, 2008- Missouri Care 

e July 21 & 22, 2008 - Children’s Mercy Family Health Partners 

e July 21 & 23, 2008 - Blue-Advantage Plus 
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Reviewers 

Two reviewers conducted the Compliance Protocol activities, including 
interviews and document review. The Extemal Quality Review Organization 

(EQ RO) Project Directorconducted backup activities and oversight of the 
Compliance Protocolteam. The Assistant Project Director wasconducting her 
fourth review. She has experience with the MO HealthNet Managed Care 
Program implementation and operations, interviewing, program analysis, and 
Medicaid managed care programsin otherstates. The second reviewer 
participated in six previous MO HealthNet Managed Care Program EQRsand on- 
site visits. This reviewer was knowledgeable about the MO HealthNet Managed 
Care Program through herexpenence asa former SMA employee responsible for 
quality assessment and improvements, asan RN, and a consultant. All reviewers 
were familiar with the federal regulations and the manner in which these were 
operationalized by the MO HealthNet Managed Care Program prorto the 


implementation of the protocols. 


Establishing an Agenda for the Visit 

An agenda wasdeveloped to maximize the use of available time, while ensuring 
that all relevant follow-up issues were addressed. A sample schedule was 
developed that specified times forall review activities including the entrance 
conference, document review, Validating Performance Improvement Project 
evaluation, Validating Performance Measures review, conducting the interview 
forthe Compliance Protocol, and the exit conference. A coordinated effort with 
each MO HealthNet Managed Care health plan occured to allow forthe most 
effective use of time forthe EQRO team and health plan staff. The schedule for 
the on-site reviews wasapproved by the SMA in advance and forwarded to 
each health plan to allow them the opportunity to prepare forthe review. 


Appendix 11 providesa sample agenda forthe on-site reviews. 


Providing Preparation Insttuctions and Guidance to the MO HealthNet MCOs 
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A letter (see Appendix 14) wassent to each MO HealthNet Managed Care 
health plan indicating the specific information and documents required on-site, 
and the individuals requested to attend the interview sessions. The health plans 
scheduled their own staff to ensure that appropnate individuals were available 


and that all requested documentation was present during the on-site review 


day. 
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OBTAINING BACKGROUND INFORMATION FROM THE STATE MEDICAID 
AGENCY 
Interviews and meetings occured with individuals from the SMA from September 
2007 through J une 2008 to prepare for the on-site review, and obtain information 
relevant to the review prior to the on-site visits. Individuals from the SMA included 
in these meetings were: 

e Sandra Levels, Director of Program Management 

e Susan Eggen - Assistant Deputy Director, MO HealthNet Managed Care 

e Andrea Smith - Quality Nurse Reviewer 
In February 2008, Compliance Review team members requested the contract 
compliance documents prepared annually by the SMA. The latest information 
on health plan compliance with the J uly 1, 2006 MO HealthNet Managed Care 
contract was reviewed, along with required annual submission and approval 
information. All documentation gathered by the SMA wasclanrified and 
discussed to ensure that accurate interpretation of the SMA findings was 
reflected in the review comments and findings. The SMA staff continued to 
complete their review of health plan policy submissions. They provided periodic 
updates on approvals throughout the EQR preparation up to the beginning of 
the on-site review process. SMA expectations, requirements, and decisions 
specific to the MO HealthNet Managed Care Program were identified during 


these disc ussions. 


DOCUMENT REVIEW 

Documents chosen for review were those that best demonstrated each MO 
HealthNet Managed Care health plan’s ability to meet federal regulations. 
Certain documents, such asthe Member Handbook, provided evidence of 
communication to members about a broad spectrum of information including 
enrollee rightsand the grievance and appeal process. Provider handbooks 


were reviewed to ensure that consistent information was shared regarding 
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enrollee rights and responsibilities SMA MO HealthNet Managed Care contract 
compliance worksheets, and specific policiesthat are reviewed annually or that 
are yet to be approved by the SMA, were reviewed to verify the presence or 
absence of evidence that required written policies and procedures existed 
meeting federal regulations. Other information, such asthe Annual Quality 
Improvement Program Evaluation, was requested and reviewed to provide 
insight into the health plan’s report of their compliance with the requirements of 
the MO HealthNet Managed Care contract and the federal regulations. 
Tracking logs relating to a number of issues were reviewed and discussed at the 
request of the SMA, to ensure that local proceduresand practices coresponded 
to the written policies submitted forapproval. When it was found that specific 
regulations were “Partially Met,” additional documents were requested of each 
health plan. In addition, in-depth interview questions were developed for 
Member Servicesand Case Management staff to establish that practice directly 
with members reflected the health plans’ written policies and procedures. 
Interviews with administrative staff also occurred to address the areas for which 
compliance wasnot fully established through the pre-site document review 


process, and to clarify responses received from the staff interviews. 


The following documents were reviewed forall MO HealthNet MC HPs: 
e State contract compliance ratings from 2007 and updated policies 
accepted through J une 2008 
e Results, findings, and follow-up information from the 2006 Extemal Quality 
Review 
e 2007 Annual MO HealthNet MCHP Evaluation, submitted April 2008 


CONDUCTING INTERVIEWS 
After disc ussions with the SMA, it wasdecided that the 2007 Compliance Review 


would include in-depth interviews with Member Servicesand Case Management 
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Staff. The goal of these interviews was to validate that practices at the health 
plans, particulary those directly affecting members’ accessto quality and timely 
health care, were in compliance with the approved policiesand procedures. 
After completing the initial document review, it wasclear that the MO HealthNet 
Managed Care health planshad made significant progress in developing and 
obtaining approval of written policiesand procedures. The interview questions 
were developed using the guidelines available in the Compliance Protocol. 
Previous interviews, generally conducted with administrative and management 
level health plan staff, did enable reviewersto obtain a clearer picture of the 
degree of compliance achieved through policy implementation. Corrective 
action taken by each health plan was determined from previous years’ reviews. 
This process revealed a wealth of information about the approach each health 
plan took to become compliant with federal regulations. The current process of 
a document review, supported by interviews with front line staff, was developed 
to provide evidence of systems that delivered quality and timely services to 
members, and the degree to which appropriate access wasavailable. The 
interviews provided reviewers with the opportunity to explore issues not 
addressed in the documentation. Additionally, thisapproach would continue to 
provide follow-up from previous EQRO evaluations. A site visit questionnaire for 
Member Services staff, case managers, and administrators was developed for 
the health plans. The questions were developed to seek concrete examples of 
activities and responses that would validate that these activities are compliant 


with contractual requirements and federal regulations. 


COLLECTING ACCESSORY INFORMATION 

Additional information used in completing the compliance determination 
included: discussions with the EQR reviewers and MO HealthNet health plan 
QI/UM staff regarding management information systems; Validating Encounter 


Data; Validating Performance Measures; and Validating Performance 
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Improvement Projects. The review evaluated information from these sources to 
validate health plan compliance with the pertinent regulatory provisions within 
the Compliance Protocol. These findings were documented on the BHC MO 
HealthNet Managed Care Compliance Review Scoring Form (Appendix 12), and 


were used to make final rating recommendations. 


ANALYZING AND COMPILING FINDINGS 

The review processincluded gathering information and documentation from the 
SMA about policy submission and approval, which directly affectseach MO 
HealthNet Managed Care health Plan’scontract compliance. This information 
was analyzed to determine how it related to compliance with the federal 
regulations. Next, interview questions were prepared, based on the need to 
investigate if practice existed in areas where approved policy wasorwasnot 
available, and if local policy and procedures were in use when approved policy 
wasnot complete. The interview responsesand additional documentation 
obtained on-site were then analyzed to evaluate how they contributed to each 
health plan’scompliance. Allinformation gathered was assessed, re-reviewed 
and translated into recommended compliance ratings foreach regulatory 
provision. This information wasrecored on the MO HealthNet Managed Care 


scoring fom and can be found in the protocol specific sections of this section of 


the report. 
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REPORTING TO THE STATE MEDICAID AGENCY 

During the August 2008 meeting with the SMA, preliminary findings and 
comparisons to the ratings from the 2006 review were presented. Discussion 
occured with the SMA staff to ensure that the most accurate information was 
recorded and to confim that a sound rationale was used in rating 
determinations. The SMA approved the processand allowed the EQRO to 
finalize the ratings foreach regulation. Sufficient detail is included in all 
worksheets to substantiate any rating lowerthan “Met.” Final worksheets are 


submitted to the SMA. The actual ratings are included in this report. 


COMPLIANCE RATINGS 

From J anuary 2008 through J une 2008, the MO HealthNet Managed Care 
Compliance Review Scoring Fom for each health plan was updated to reflect 
their current level of MO HealthNet Managed Care contract compliance. The 
Scoring Form continued to present a crosswalk of contract referencesthat 
created compliance with each federal regulation. The SMA instructed the EQRO 
to utilize the Compliance Rating System developed during the previous review. 
This system was based on a three-point scale (“Met,” Partially Met,” “Not Met”) 
for measuring compliance, asdetermined by the EQR analytic process. 
Appendix 12 contains the BHC MO HealthNet Managed Care Compliance 
Review Scoring Form worksheet utilized forall health plans. The determinations 
found in the Compliance Ratings considered SMA contract compliance, review 
findings, health plan policy, ancillary documentation, and staff interview 
summary responses that validate health plan practices observed on-site. In 
some instances the SMA MO HealthNet Managed Care contract compliance 
tool rated a contract section as “Met” when policies were submitted, even if the 
policy had not been reviewed and “finally approved.” If the SMA considered 
the policy submission valid and rated it as “Met,” this rating was used unless 


practice or other information called this into question. If thisconflict occured, it 
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wasexplained on the Compliance Review Scoring Form. The scale allowed for 


credit when a requirement was Partially Met. Ratings were defined as follows: 
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All documentation listed under a regulatory provision, or one of its 
components was present. MO HealthNet Managed Care health plan staff 
was able to provide responses to reviewers that were consistent with one 
another and the available documentation. Evidence was found and could be 
established that the health plan was in full compliance with regulatory 
provisions. 


Partially Met : There was evidence of compliance with all documentation requirements, but 
staff was unable to consistently articulate processes during interviews; or 
documentation was incomplete or inconsistent with practice. 


Not Met: Incomplete documentation was present and staff had little to no knowledge 
of processes or issues addressed by the regulatory provision. 





5.3 Findings 


ENROLLEE RIGHTS AND PROTECTIONS 

Subpart C of the regulatory provisions for Medicaid managed care (Enrollee 
Rights and Protections) sets forth 13 requirements of heath plans for the provision 
of information to enrolleesin an understandable fom and language: written 
policies regarding enrollee rights and assurance that staff and contractors take 
them into account when providing services; and requirements for payment and 
no liability of payment for enrollees. There wasonly one item acrossall MO 
HealthNet Managed Care health plansthat wasrated as “Not Met” (see Table 
42). Acrossall health plans 94.87% of the regulations were rated as “Met.” Thisis 
an overall improvement over the 90.77% “Met” rating in 2006 and significant 
improvement over the rate of 76.92% at the time of the 2005 EQR. Five of the 
health plans (Children’s Mercy Family Health Partners, Missourn Care, Mercy 
CarePlus, HealthCare USA and Blue-Advantage Plus) were found to be 100% 
compliant. One health plan (Harmony Health Plan) was rated as 69.2% “Met.” 
This is the first year that Harmony Health Plan is being rated for Compliance with 
the MO HealthNet Managed Care contract and the federal regulations. They 
have submitted required policy, and are in the process of completing the 
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approval process. 
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Table 42 - Subpart C: Enrollee Rights and Protections 
MO HealthNet MCHP All MO HealthNet MCHPs 


Number 
Partially | Number 
Federal Regulation MCP Harmony | HCUSA CMFHP BA+ Met Not Met | Rate Met 
2 2 2 2 2 2 6 0 0 


438.100(a) Enrollee Rights: General Rule 100.0% 


438.10(b) Enrollee Rights: Information Requirements 2 2 2 2 2 2 100.0% 





438.10(c)(3) Alternative Language: Prevalent Language 100.0% 


438.10(c)(4,5) Language and Format: Interpreter Services 100.0% 
438.10(d)(1)(i) Information Requirements: Format/Easily 
Understood 100.0% 


438.10(d)(1)(ii)and (2) Information Requirements: Format 
Visually Impaired, and Limited Reading Proficiency 100.0% 


438.10(f) Information for All Enrollees: Free Choice, etc. 83.3% 
438.10 (g) Information to Enrollees: Specifics/Physician 
Incentive Plans 100.0% 


438.10(i) Special Rules: Liability for Payment/Cost Sharing 100.0% 
438.100(b)(2)(iii) Enrollee Rights: Provider-Enrollee 

Communications 83.3% 
438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 

Directives 83.3% 


438.100(b)(3) Right to Services 83.3% 


438.100(d) Compliance with Other Federal/State Laws 
Number Met 


100.0% 





Won 


Number Partially Met 0 0 0 0 0 
Number Not Met 0 1 0 0 0 0 
Rate Met 100.0% 69.2% 100.0% 100.0% 100.0% 100.0% 





Note: 0 =Not Met; 1=Partially Met ; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services (2003). Monitoring Medicaid Managed Care 
Organizations (MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2007 Extemal Quality Review Monitoring MC HPs Protocols. 
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Allhealth plans had proceduresand practicesin place to ensure that members: 
receive pertinent and approved information [438.100(a) and 438.10(b)]; were 
addressed in their prevalent language [438.10(c )(3)]; have accessto required 
interpreter servic es [438.10(c )(4,5)]; that all information is provided in an easly 
understood format [438.10 (d)(1)(i)/438.10(d)(1)(ii) & (2); that members are 
treated with respect and dignity and receive information on available treatment 
options and altematives [438.100(b)(2)(iii)/438.10(g)]; and the that the health 


plans are in compliance with other state requirements [438.100(d)]. 


A numberof health plans (Children’s Mercy Family Health Partners, Missouri Care, 
Mercy CarePlus, Blue-Advantage Plus, HealthCare USA) utilized EQR tools, 
including the MO HealthNet Managed Care Compliance Review Scoring Form, 
to assist them in ensuring completion of required policy as well as meeting the 
requirements of the federal regulations. Improvement was noted in the attention 
the majority of the health plans gave to meeting all standards of compliance. 
Tracking systems were putin place, and in some situations staff members were 
assigned to monitor compliance issues. The health plansstressed their 
heightened awareness of the need for positive interdepartmental 
communication. These efforts focused on strengthening communication to 


enhance the organizations ability to serve members needs. 


Two of the health plans (Children’s Mercy Family Health Partners, Blue- 
Advantage Plus) utilized a Member Advisory Committee to provide insight into 
the issues faced by membersin trying to obtain healthcare services. The health 
plansincormorated member suggestions into their operations and marketing 
materials. These activities were indicators of the health plans’ commitment to 


member services and to ensuring that members have quality healthcare. 


All health plans continued to operate programs for the provision of behavioral 


health services. Four of the health plans subcontract with Behavioral Health 
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Organizations (BHO) for these services. Two health plans (Missoun Care, Harmony 
Health Plan) utilize an “in-house” model for the provision of behavioral health 
services. One of these plans (Missoun Care) doescase management and 
maintenance of the provider delivery system within their health plan structure. 
One health plan (Harmony) utilized a subsidiary of their parent company to 


provide behavioral health services during 2007. 
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All health plans provided active oversight, if not direct involvement, of their 
behavioral health subcontractors. Behavioral Health Services have evolved into 
an important resource forMO HealthNet Managed Care members. A majority of 
the health plans’ subcontracted behavioral health partners (MHNet, Missouri 
Care, New Directions Behavioral Health, and Harmony Behavioral Health) 
approved the use of in-home services to reach members who would not attend 
appointments in an office setting. Thisnot only ensured that members obtained 
the help they needed, but also prevented missed appointment for providers. 
One BHO (New Directions Behavioral Health) serves members from Children’s 
Mercy Family Health Partners and Blue-Advantage Plus. ThisBHO continuesto 
contract with a provideragency that delivered short-term intensive in-home 
servicesin an effort to avert crisis that may lead to inpatient treatment, and to 
work with members to utilize all available community resources. This service is 
available to both health plans. Two health plans (Mercy CarePlus, HealthCare 
USA) reported on initiatives to engage members who were pregnant, in an 
attempt to identify any mental health issues that might affect the mother and/or 
baby. These efforts also focused on prevention of postpartum depression. One 
health plan (Children’s Mercy Family Health Partners) described an initiative 
where in-home services were provided to members following any inpatient 
treatment to ensure effective follow-up services. The BHO contracted with 
specific providers who were skilled at working in intensive in-home settings. The 
BHO absorbed the cost of unreimbursed services, such as after-hours telephone 
support, in an effort to reduce readmissions for these members. MO HealthNet 
Managed Care health plansand BHOsdescribed a numberof interventions that 
met members’ needs, but were extraordinary in nomal Medicaid programs. This 
reflected a level of performance indicative of their trong commitment to access 


and quality services forall members. 
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COMPLIANCE INTERVIEWS — MEMBER SERVICES STAFF AND CASE 
MANAGEMENT (BEHAVIORAL HEALTH) 

Interviews were held at each health plan with Member Services Staff and Case 
Management Staff. Subsequently an interview occured with Administrative Sta ff 
to obtain clarification on issues identified from the policy and document reviews, 
and additionally from the responses received from the front line staff interviews. 
Interview tools, developed from the questionnaires included in the Compliance 
Protocol, were developed for Customer Services Staff and Case Management 
staff (see Appendix 13). 


The members of the customer service staff and the case managers interviewed 
exhibited a deep sense of commitment and professionalism when interacting 
with clients. The responses received reflected a thorough knowledge of each 
health plans policiesand procedures. Member Services staff makes every effort 
to ensure that they provide MO HealthNet members with the information they 
need to make informed health care choices. They are trained to inform health 
plan membess of the providers and services available and how to access these 
services. These health plan staff members are expenenced in ensuring that MO 
HealthNet members have access to someone who speaks their language, or 
have accessto a method of communication that enables them to obtain 
complete and thorough information. In most instances Member Services staff 
members gave concrete examples of assisting members by calling providers 
directly, immediately contacting case management staff to obtain assistance 
fora member, or made another contact to ensure that members received 


appropnate and timely health care. 


Case Managers reported a clear understanding of the referral process and that 
the health plan had procedures in place to ensure that case managers received 
referrals from all sources. Case Managersdescribed processes for contacting 


new referrals and the activities required for existing members cases. One health 
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plan (Mercy CarePlus) refers all pregnant members for case management. The 
OBcase managers discussed the referral sources, and the assessment process 
that ensures that members receive the typesand frequency of services required. 
The case managers understand that accepting their servicesisa choice for 
members, but state that most membersare willing to accept case 
management, although some do have reservations. If a health plan member 
refuses case management services initially, they can request these servicesata 
future date. Treatment planning occurs with the member to ensure that they 
understand their service issues and additional assistance that will be provided. 
Providing a written copy of the treatment plan to health plan membersdid not 


occurregulany. 


Case managersalso described a methodology and provided concrete 
examples of coordination of care with behavioral health team members or 
Behavioral Health Organization (BHO) staff. They were also aware of the need to 
ensure that Primary Care Providers were involved when members were receiving 


both physical and mental health services. 


Both case managers and member services staff were keenly aware of members’ 
rights and responsibilities. These health plan staff members shared a 
commitment to providing servicesto members in the least restrictive environment 


and most respectful manner possible. 


QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT: ACCESS 
STANDARDS 


Subpart D of the regulatory provision for Medicaid managed care sets forth 17 
regulations goveming accessto services. These regulationscallfor the 
maintenance of a network of appropriate providers including specialists; the 
ability to access out-of-network services in certain circumstances; adequate 
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Care coordination for enrollees with special healthcare needs; development ofa 
method for authorization of services, within prescribed timeframes; and the 
ability to accessemergency and post-stabilization services. There were no items 
rated as “Not Met” (see Table 43). Acrossall MO HealthNet Managed Care 
health plans, 92.16% of the regulations were “Met,” which isa substantial 
improvement over the rate of 78.99% at the time of the 2005 EQR, buta slight 
decrease from the rate of 97.65% achieved in 2006. Five of the MCHPs 
(Children’s Mercy Family Health Partners, Blue-Advantage Plus, Mercy CarePlus, 
HealthCare USA, and Missoun Care) were found to be 100%compliant. One 
health plan (Harmony Health Care of Missoun) wasrated as 52.9%. This is the first 
year that Harmony Health Plan is subjected to the full compliance review. They 
continue to be in the processof submission and approval of written policy and 


procedures with the SMA. 
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Table 43 - Subpart D: Quality Assessment and Performance Improvement Access Standards 


MO HealthNet MCHP | All MO HealthNet MCHPs 
Number 
| Number } Partially | Number 


Federal Beguiion: MCP | Harmony} HCUSA | MOCare | CMFHP BA+ Met Met Not Met | Rate Met 


8.20610) Avalabity of Services: Provider Network | a) agg ggg aa a 
438.206(b)(3) Second Opinions a | | Gg |_| 100.0% | 


438.206(0)(5) Out of Network Services: Cost Sharing kkk) | || | | | (100.0% 
438.206(c)(2) Provider Services: Cultural Competency 2k) kk 20008 | 
438.208(c)(1) Care Coordination: Identification kat) || | | | || 88H 
438.208(C)() Care Coordination: Treatment Plans) at) || |) | || 88 
438.210(0) Authorization ofservies ak) at) | |) | || 88H 
438.210(d) Timeframes for Decisions, Expected Authorizations 2) 22) kk (000% | 


CRRA EE CC EEA 


Number Partially Met Se 


Number Wot Mit [—o | o [| o |» | o | 0 
Rate Wet 


Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services (2003). Monitoring Medicaid Managed Care 
Organizations (MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2007 Extemal Quality Review Monitoring MC HPs Protocols. 
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All MO HealthNet Managed Care health planshad policiesand practice that 
reflected the members right to a second opinion and a third opinion if the first 
two disagreed [438.206(b)(3)]. Other areas where all health plans were 100% 
compliant with complete and approved policy were Adequate and Timely 
Service and Cost Sharing for Out of Network Services; Timely Accessto Care, 
Provider Cultural Competency; Timeframes for Decisions for Expedited 
Authorizations, Utilization Management Activities, and Emergency and Post- 
Stabilization Services. Throughout this review period, all health plans reported 
incidents where they found providers who were familiar with members’ cultural 
and language needs. Sensitivity to and respect formembers' cultural needs was 
an area where the health plansexcelled. All health plans were fully compliant in 
having SMA approved notifications of adverse actions [438.210(c)]. There were 
no identified incidents of incentivizing staff or contractors for utilization 
management decisions that were in the favor of the MO HealthNet Managed 
Care health plans. All policiesand practices in this area [438.210(e)] were 


compliant. 


The area of accessto care waSa primary focus of improvement for all the health 
plans during 2007. Evidence existed of efforts to inform members of available 
providers, urgent care centers, and hospitals through presentations at 
community events and newsletters. The need to ensure that members received 
appropnate referralsto PCPsand specialty providers was cleanly reflected in 
Member Service Staff and Case Management interviews. Required 
documentation and approved policies did exist in all areas forall health plans 
but one (Harmony Health Plan of Missoun). Five of the MO HealthNet Managed 
Care health plans (Mercy CarePlus, HealthCare USA, Missoun Care, Children’s 
Mercy Family Health Partners, and Blue-Advantage Plus) had complete policy 
and practices, and Provider Manual language in the area of emergency and 
post-sta bilization servic es [438.114]. One MO HealthNet Managed Care health 


plan (Harmony Health Plan of Missoun) continues to have policy under review 
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awaiting final approval by the SMA. The health plans made effortsto ensure that 
the problems they experenced did not affect servicesto members. All health 
plans provided evidence of strong relationships with their providers and 
maintained strong communication with them particulary in solving member 
service problems. Harmony Health Plan reported that they are continuing active 
recruitment efforts in the outlying counties in the region. However, their network 


hasimproved in all areas during the past year of operation. 


The health plans made a concerted effort to ensure that members had 
appropnate and timely accessto services. They continued to expressconcem 
over the shortage of specialists in the areasof orthopedic surgery, pediatric 
neurology, heumatology, and child/adolescent psychiatrists. All health plans 
reported utilizing out-of-network providers and often paying commercial or 
higher rates to obtain these services. One health plan (Children’s Mercy Family 
Health Partners) had a number of specialists who requested that they not be 
included on the MO HealthNet MCHP’s published network, but readily agreed to 
service members, when requested, at the MO HealthCare Managed Car rate. 
A number of the health plans (HealthCare USA, Missouri Care) continued to 
partner with teaching hospitals in their Regions, in order to increase their 
available surgical and specialist capacity. All health plans had an intemal 
system that could provide specialist services, even in specialties that were 


normally difficult to access, when required to meet members’ healthcare needs. 


All health plans exhibited a deep commitment to delivering and providing 
oversight of behavioral health services. One health plan (Missouri Care) no 
longer usesa subcontracted network for behavioral health. This health plan 
recognized a number of advantagesin directly supervising the provision of 
behavioral health services. They contracted with the majority of the active 
providers previously utilized by the subcontractor. They were able to recruit 


additional providers through the use of solo practices, particulary those who 
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provided in-home treatment services. They maintained the same toll-free 
telephone number for member access, and conducted providertraining. Some 
of the benefits identified included: reducing the use of inpatient treatment; 
more timely and complete prior authorizations; and improved case 
management, particulary formembers who require both physical and mental 
health treatment. They did experience some difficulties in motivating the smaller 
providers to comply with timely claims submission requirements, but through 
training are seeing improvements in this area. Thishealth plan’s case managers 
also reported that communicating with behavioral health case managers, and 
coordinating services between behavioral health providersand PCPs improved 


with this new service delivery system. 
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MEMBER SERVICE STAFF AND CASE MANAGER INTERVIEWS 

Member Services and Case Management staff both reflected that one of the 
key aspects of their role isensuring the members receive proper health care is 
ensuring adequate accessto health care. These staff members report that they 
answer many questions regarding identification of PCPs and their address, 
assisting in changing PCPs fornew members particularly if an auto-assignment 
occured, and in ensuring that members receive timely appointments. These 
staff also assists members in identifying and obtaining appointments with 
specialists. They respond to questions about authorization for services, and assist 
members in finding physicians who meet members cultural and language 
needs. These staff members were animated in their discussion about finding the 
best physician or medical provider for health plan members with special needs. 
Their responses reflected a sincere desire to assist members in their access to 
Care issues, and a sense of accomplishment when this occured ina timely and 


efficient manner. 


QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT: STRUCTURE AND 
OPERATION STANDARDS 


There are 10 Structure and Operations Standards for ensuring compliance with 
State policiesand procedures forthe selection and retention of providers, 
disenrollment of members, and accountability for activities delegated to 
subcontractors. There were no itemsacrossMO HealthNet Managed Care 
health plans that were rated as “Not Met.” AcrossMO HealthNet Managed 
Care health plans, 95%of the regulations were “Met,” which isan improvement 
over the rating of 88.6% from the 2005 EQR and a decrease from 2006 when 


health plansachieved a rate of 98% compliance in this area (see Table 44). 
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Table 44 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation Standards 


MO HealthNet MCHP | All MO HealthNet MCHPs 
| Number ] 





Number 
Not Met 


Number | Partially 


Federal Regulation ccP Harmony | HCUSA MOCare CMFHP BA+ Met Met Rate Met 

















438.214(a,b) Provider Selection: Credentialing/Recredentialing 





2 1 2 2 Zz 2 5 





i 





438.214(d) Provider Selection: Excluded Providers 


ee es ee ee ee ee ee ee ee 
438.226 and 438.56(b)(1-3) Disenrollment: Requirements and 


ee 


438.228 Grievance System A EE A 


Naber Mer — 10 | 7 | ww | 1 | 10 | 10 (Ry 3 0 95.0% 
ee 

Number Not Met 
70.0% 100.0% 100.0% 100.0% 100.0% 
Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services (2003). Monitoring Medicaid Managed Care 
Organizations (MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 


Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2007 Extemal! Quality Review Monitoring MC HPs Protocols. 
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The Provider Services departments of all MO HealthNet Managed Care health 
plans exhibited a sound and thorough understanding of the requirements for 
provider selection, credentialing, nondiscrimination, exclusion, and MO 
HealthNet Managed Care requirements. Five of the MO HealthNet Managed 
Care health plans (Children’s Mercy Family Health Partners, Blue-Advantage Plus, 
Missoun Care, Mercy CarePlusand HealthCare USA) were 100% compliant with 
all regulations. The final health plan (Harmony Health Plan of Missouri) met 70% of 
the regulations. Seven of the individual regulations were 100% met. This included 
Provider Selection [438.214(d) and 438.214(e)]. The staff at each health plan 
understood the requirements for disenrollment. They were 100% “Met” forthe 
applicable regulations for timeframes [438.56(e)]. All of the health plans met all 
regulations for disenrollment procedures. Five of the health plans (83.3%; 
Children’s Mercy Family Health Partners, Blue-Advantage Plus, Missouri Care, 
Mercy CarePlus and HealthCare USA) had appropriate grievance systems in 
place that met the requirements of this regulation [438.228]. Two of the health 
plans (HealthCare USA, and Blue-Advantage Plus) described credentialing and 
re-credentialing policies that exceeded the requirements of the regulations. 
Providers were willing to submit to these stricter standardsto maintain network 
qualifications in both the health plans and other commercial networks. Overall, 
five (83.3%) of the health plans had all required policiesand practicesin place 
regarding credentialing. One health plan (Harmony Health Plan of Missouri) 
continued to have outstanding policy in the area of credentialing, non- 
discrimination and sub-contractual relationships (438.214 

(a,b )/438.214(c )/438.230)(a,b). 


All health plans understood the required oversight of subcontractors. The 
compliance rate for this regulation [438.230(a,b)] improved from the 2005 rate of 
71.4%, to the 2007 rate of 83.3%. 
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Regulations 

All previous deficiencies for Structure and Operation Standards related to a lack 
of submitted orapproved policies orsubcontractor agreements. The health 
plans exhibited a significantly improved understanding and attention to these 
detailsand requirements during this review. Interviews revealed that Member 
Services staff quickly identifies problems if they receive callsrelated to these 
issues. However, it is their responsability to refer these issues and questions to the 
provider services staff as quickly as possible. The Member Services staff make 
notes of all of theirtelephone contactsin the health plans’ intemal systems and 
make appropriate referrals. These processes were described in detail and are 


clearly understood by the staff involved. 
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QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT: MEASUREMENT 
AND IMPROVEMENT 

There are 12 Measurement and Improvement Standards addressing the 
selection, dissemination, and adherence to practice guidelines; the 
implementation of performance improvement projects; the calculation of 
performance measures; the evaluation of the availability of services and 
assessment techniques for enrollees with special healthcare needs; and the 
maintenance of information systems that can be effectively used to examine 
service utilization, gievancesand appeals, and disenrollment. All items were 
either “Met” or “Partially Met” forcompliance with Measurement and 
Improvement (see Table 44). A total of 89.4% of the criteria were “Met” by the 
MO HealthNet Managed Care health plans, which continues to indicate 
improvement in meeting federal requirements, over the 2005 rate of 83.1% 
However, this isa decrease from the rate of 98.2% achieved in 2006. Thisnumber 
again reflects that one health plan (Harmony Health Care of Missouni) is 
continuing to submit policy forSMA approval. Five health plans (Missoun Care, 
Children’s Mercy Family Health Partners, Mercy CarePlus, HealthC are USA, and 


Blue-Ad vantage Plus) met all the requirements (100%) in this area. 
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Table 45 - Subpart D: Quality Assessment and Performance Improvement Measurementand Improvement 
| MO HealthNet MCHP All MO HealthNet MCHPs 
) Number 
Number | Partially | Number 


Federal Regulation McP Harmony | HCUSA MOCare | CMFHP BA+ Met Met Not Met | Rate Met 


438.236(b)(1-4) Practice Guidelines: Adoption a a A 


438.236(d) Practice Guidelines: Application ee es ee ee ee eee eee 


438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCHP Quality 
Improvement and PIPs 2 1 2 2 2 5 1 83.3% 


438.240(e) QAPI: Program Review by State 


ar Pra ae Met 
Number ar Pra ae Met 


Number Not Met es 
Rate Met 


Note: Regulation 438.240(e) refers to program review by the garecihe eousHon aquresthe state to view: at least annually, the impact and 
effectiveness of each MCHP's quality assessment and performance improvement program. The regulation refers to the state QA & | program review 
processand isnot applicable to Extemal Quality Review of the MO HealthNet Managed Care Program. This percent is calculated forthe regulations 
that are applicable tot the MO HealthNet Managed Care Program. 

0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services (2003). Monitoring Medicaid Managed Care 
Organizations (MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2007 Extemal Quality Review Monitoring MC HPs Protocols. 
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During previous reviews the area of practice guidelines was problematic fortwo 
health plans (Mercy CarePlusand HealthCare USA). Both had relatively new 
Medical Directors, who identified resistance on the part of the medical 
community in the St. Louis area to the acceptance orimplementation of 
practice guidelines. The specific requirements of the regulations were related to 
both health plans. Both of these health plans improved in this area during the 
2007 review. They have practice guidelinesin place and are monitoring 
providers to ensure their utilization. Currently all six of the health plans (100%) met 
all the requirements for adopting, disseminating and applying practice 
guidelines. In the Westem Region, staff from the health plans meets with a 
quality enhancement group in the healthcare community (Kansas City Quality 
Improvement Consortium). Regional standardsand practices were disc ussed 
and regionally specific standards, that met orexceeded nationally accepted 
guidelines, were developed. All health plansrelated that they expected 
providers to use the practice guidelines combined with their experience and 
patient knowledge in their decision-making. When conflicts occurred, the 
Medical Director reviewed the situation and consulted with the provider in an 
effort to ensure that the services that were provided were in the members best 


interested. 


Five of the health plans (83.3%) used nationally accredited criteria for utilization 
management decisions [438.240(b)(3)]. The toolsthe health plans reported using 
included the InterQual Clinical Decision Support Tool, LOCUS/CALOCUS (Level of 
Care Utilization System/Child and Adolescent Level of Care Utilization System) for 
utilization management decisions in the provision of behavioral health services 
and the Milliman Care Guidelines. These sources provided evidence-based 
criteria and best practice guidelines for healthcare decision-making. The health 
plan staff was able to articulate how they utilized these tools and apply them to 
member healthcare management issues. The MO HealthNet Managed Care 


health plans used all information available to them to ensure that evidence- 
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based practice ensuring member safety while controlling medically unnecessary 
care. During the Member Servicesand Case Management interviews, staff was 
asked about members’ knowledge of or requests for practice guidelines. One 
health plan (Mercy CarePlus) reported one incident of a mother who isan RN 
requesting copies of the Asthma practice guidelines prorto attending her child’s 
health care appointment. This parent was aware of the guidelines and wanted 
to ensure that herchild received the best treatment. Other health plans (Blue- 
Advantage Plus, Children’s Mercy Family Health Partners) reported that members 
haven't actually requested practice guidelines, but have requested treatment 
procedures, particulary in the instance of member with asthma. Members were 
provided with this information that assisted in ensuring that their children 


obtained appropnate levels of information. 


The health plans were actively involved in developing and improving their 
Quality Assessment and Improvement Programs. Two of the health plans (Blue- 
Advantage Plus, Children’s Mercy Family Health Partners) utilized community 
based advisory boards, one of which (Children’s Mercy Family Health Partners) 
included members. These groups assisted the health plansin assessing member 
needsand bamiersto services. Both health plans utilized the recommendations 
of these groupsin their operations, member information, and daily activities. All 
of the health plans developed intemal systems for monitoring, analysis and 
evaluation of theirown programs. Five (83.3%) had a program and all required 
policy and proceduresin place to meet the requirements of the federal 
regulations [438.240(a )(1)]. Harmony Health Plan of Missouri continues working 


with the SMA on submission and approval of all required policy. 


All health plans compliance improved in the section of the protocol involving 
Validating Performance Improvement Projects, Validating Performance 
Measures, Validating Encounter Data, and Health Information Systems. Detailed 


findings and conclusions for these items are provided in previous sections of this 
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report and within the MO HealthNet Managed Care health plan summaries. 
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GRIEVANCE SYSTEMS 

Subpart F of the regulatory provisions for Medicaid managed care (Grievances 
and Appeals) sets forth 18 requirements for notice of action in specific language 
and format requirements for communication with members, providers and 
subcontractors regarding grevance and appeal procedures and timelines 
available to enrollees and providers. Five of the six health plans excelled (100%) 
in theircompliance with the regulations related to grievancesand appeals (see 
Table 46). There were no itemsrated as “Not Met.” These five health plans 
(Mercy CarePlus, HealthCare USA, Children’s Mercy Family Health Partners, 
Missouri Care, and Blue-Advantage Plus) were found 100% in completing 


required policy, procedure, and practice in their Grievance Systems. 


One health plan (Harmony Health Care of Missoun) continued to have policy 
and procedures that required approval by the SMA. The six health plans overall 
score forthis section is 84.3%. Thisnumber reflects that Harmony Health Plan of 


Missour’ has not completed the policy submission and approval process. 
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Table 46 - Subpart F: Grievance Systems 


MO HealthNet MCHP All MO HealthNet MCHPs 


Number Number Number Not 
Federal Regulation Harmony HCUSA MOCare Met Partially Met Met Rate Met 


438.402(b)(1) Grievance System: Fillng Requirements - Authority re Px 83.3% 
438.402(b)(3) Grievance System: Filing Requirements - 

Procedures 2 1 2 2 2 2 1 83.3% 
438.404(b) Notice of Action: “Content ia |. | La tee) | | 83.3% 
438.406(a) Handling of Grievances and Appeals: General 

Requirements 2 1 2 2 2 2 1 83.3% 
438.408(a) Rescue oan daNonicanont Paste hue oe es 4 |. | za | | 83.3% 
438.408(d)(e) Resolution and Notification: Grievance and 

Appeals - Format and Content of Notice 2 1 2 2 2 2 1 83.3% 
poe 410 (Expedited: Resolutionsor Appeals ia | & | | gs Loa | | 83.3% 
438.416 Recordkeeping and Reporting Requirements [oe | I" go 83.3% 


Number Partially Met 


a a a a 
h(E ES 
rene (ed Ee Ee 
Note: 0 =Not Met; 1=Partially Met; 2 =Met 
Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services (2003). Monitoring Medicaid Managed Care 
Organizations (MCHPs) and Prepaid Inpatient Health Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2007 Extemal! Quality Review Monitoring MC HPs Protocols. 
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Grievance and Appeal reports for both members and providers were reviewed 
for 2007, as submitted to the SMA. The health plans reported different numbers 
and typesof concems. The numberof member gnevancesand appeals varied 
between the health plans. However, the numbers were proportional to health 
plan enrollment. Provider complaints, grievances, and appealsalso varied but 
were not disproportional to the provider network. 


In analyzing the Gnevance System report, the most frequent issues included: 


Provider - Complaints, Grievances, and 
Appeals 

Transportation Authorizations - Denied/Late/None 
Prescription Drug Issues Billing Problems 

Appointment Availa bility/C ontinuity of 
Treatment 


Member - Grievances and Appeals 


Contractual Issues 


Treatment by Provider/ Staff Untimely Submission of Claims 
Service Category/Prior Auth. (denial) Uncovered Benefit 

Claims Issue/ Uncovered Benefit Additional Information Required 
Inability to Find PC P/Specialist - or 
Obtain an Appointment 

State Fair Hearing Request 


Medical Necessity Question 





The largest number of member grevance/appeals continued to concem 
transportation issues. The largest number of provider 
complaints/grievances/appeals continued to include authonzation issues and 
untimely submission of claims. The majority of the claims were the result of 
payment disputes, although a number of grievancesand appeals filed by 
providers did dispute decisions that appeared to affect the quality of care 


received by members. 


There were no deficienciesin the Grievance System policy submission for five of 
the six health plans. The health plans are diligent in maintaining policiesand 
practicesin this area to ensure that these systems are up-to-date and comply 
with the SMA contract requirements and federal regulations. Appropriate 
practice foraddressing member grievance and appeals, and provider 
complaints, gievancesand appeals appeared to be in place forall health 
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plans. 


Interview results reflect that the health plans have specific units or persons who 
respond to member grnevancesand appeals and provider complaints 
grievancesand appeals. Member Services staff are often the first individuals to 
hear about issues that members have with either providers or with the health 
plan itself. They assist the member in making an informed decision about filing a 
gnevance orappeal, and they refer the issue to the appropnate person or unit in 
their health plan. They do not process grievances or appeals for members. 
However, most plansdescribed a case management system where the number 
and type of casesorissuesare reflected in the notesthat staff record on all 
member contacts. These processes are resulting in timely processing of the 
complaints, gievancesand appeals. Staff is aware that it isthe member's 
decision to file a grievance orappeal. However, they record their conversations 
regardless of the choicesmade. Staff states that ifa memberchooses not to file 
a gnevance orappeal, and it appears that the health plan ora providerhad an 
issue with a member, they send these noteson to the Grievance and Appeal 
Unit, and/orto Provider Services for follow-up to ensure that all issues are 


resolved. 


5.4 Conclusions 


Acrossall MO HealthNet Managed Care health plans there wasa substantial 
improvement in the area of compliance with federal regulations. There was only 
one regulations rated as“Not Met.” All other individual regulations were rated as 
“Met” or “Partially Met.” Five of the health plans were 100% compliant with all 
requirements. The remaining health plan wasonly 5.6% compliant with the 


regulations related to Gnevances; 69.2% compliant with Enrollee Rights and 
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Protections; 52.9% compliant with Access Standards; 70% compliance with 
Structure and Operations; and 36.4% compliant with Measurement and 
Improvement. With the exception of one health plan, which isin the process of 
completing their first compliance review, this indicates significant improvement in 
becoming compliant with the State SMA contractual requirements and the 
corresponding federal regulations overthe 2006 EQR. Allsourcesof available 
documentation, interviews, and observations at the on-site review were used to 
develop the ratingsforcompliance. The EQRO comments were developed 
based on review of thisdocumentation and interview responses. Several of the 
health plans made it clear that they used the results of the pror EQRto complete 
and guide required changes. One health plan (Mercy CarePlus) significantly 
improved and stated that they utilized the compliance protocol asa tool to 
develop their performance and improve servicesto members. This health plan 
achieved improved compliance to 100% in every category. The following 
summarizes the strengths in the areasof Accessto Care, Quality of Care and 


Timeliness of Care. 


Recommendations are based on the findings utilizing the Protocol for 


Determining Compliance with Medicaid Managed Care Regulations. 


QUALITY OF CARE 

Eight of the 13 regulations for Enrollee Rights and Protections were 100% “Met.” 
Communicating MO HealthNet Managed Care Members rightsto respect, 
privacy, and treatment options, as well ascommunicating, orally and in writing, 
in theirown language or with the provison of interpretive servicesisan area of 
strength forall health plans. The MO HealthNet Managed Care health plans 
communicated that meeting these requirements with members and providers, 
created an atmosphere with the expectation of delivering quality healthcare. 
The health plans maintained an awareness of and appropnate responses to 


culturaland language bamersconceming communication in obtaining 
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healthcare. The health plans responded to physical, emotional and cultural 
bamiers experienced by members with diligence and creativity. The health plans 
were aware of theirneed to provide quality servicesto membersin a timely and 


effective manner. 


Seven of the 10 regulations for Structure and Operations Standards were 100% 
“Met.” These included provider selection, and network maintenance, 
subcontractual relationships, and delegation. The health plans had active 
mechanisms for oversight of all subcontractorsin place. All health plans 
improved significantly in compliance with this set of regulations and articulated 
their understanding that maintaining compliance in thisarea enabled them to 


provide quality servicesto theirMO HealthNet Managed Care Members. 


ACCESS TO CARE 

Five of the MO HealthNet Managed Care health plans were fully compliant with 
the 17 federal regulations conceming Access Standards. These included: 
provider networks; freedom of choice and accessto all services; out-of-network 
services; timely accessto care; core coordination; authorization of services; 
appropnate notifications; timeliness of decisions regarding care and emergency 
and post-stabilization services. The six MO HealthNet Managed Care health 
plans monitored high risk MO HealthNet Managed Care Membersand had 
active case management servicesin place. Each health plan described 
measures they used to identify and provide services to MO HealthNet Managed 
Care Members who have special healthcare needs. Many of these case 
management programs exceeded the strict requirements in the MO HealthNet 
Managed Care contract. All six health planscould describe efforts to 
participate in community events and forumsto provide education to members 


regarding the use of PCPs, special programs available, and how to access their 
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PCP and other specialist service providers that might be required. The health 
plans were crucially aware of their responsability to provide accessto care and 
services, and to communicate complete information on this topic to their 


members. 


TIMELINESS OF CARE 

Four of the 12 regulations for Measurement and Improvement were 100% “Met.” 
Five of the sx MO HealthNet Managed Care health plans met all of the 
regulatory requirements. All six health plans adopted, disseminated and applied 
practice guidelinesto ensure sound and timely healthcare services for members. 
The health plans used their health information systems to examine the 
appropnate utilization of care using national standard guidelines for utilization 
management. The health plans were beginning to utilize the data and 
demographicsin their systems to track and trend information on membess to 
assist in determinations of risk and prevention initiatives. Several health plans 
began using member and community based quality improvement groupsto 
assist in determining bamiersto servicesand methods to improve service delivery. 
The Member Services and Case Management departments had integral working 
relationships with the Provider Services and Relations Departments of the health 
plans. All front line staff and administrators interviewed exhibited a commitment 
to relationship building, as well as monitoring providersto ensure that all 
standards of care were met and that good service, decision-making, and sound 
healthcare practicesoccured on behalf of health plan members. The health 
plans all provided examples of how these relationships served to ensure that 
members received timely and effective healthcare. The health plan staff would 
contact providers directly to make appointments whenever members expressed 


difficulty in obtaining timely services. 
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All 18 regulations for Grievance Systems were 100% “Met” for five of the health 
plans. One health plan (Harmony Health Care of Missoun) continues to work 
toward completion of adequate and approved policy with the SMA. The five 
remaining health plans were 100% compliant with the requirements for policy, 
procedure and practice in the area of Grievance Systems. The health plans 
provided examples of how timely decision-making allowed members to obtain 
their healthcare quickly and in the most appropnate setting. The health plans 
understood that maintaining this system wasan essential component to ensuring 


timely accessto healthcare. 


MO HealthNet Managed Care health plans remained invested in developing 
programs and providing services beyond the strict obligations of the contracts. 
Preventive health and screening initiatives exhibited a commitment to providing 
the best healthcare in the least invasive manner to their members. Partnerships 
with local universities and medical schools provided opportunities to obtain 
cutting-edge and occasionally experimental treatment options, which would not 
otherwise be available to members. The health plans observed that these efforts 
combined to create a system that allowed memberstimely access to quality 


healthcare. 


RECOMMENDATIONS 
1. Continue to distribute the completed compliance toolsto the health 
plans to ensure recognition of the policies and procedures that must be 
completed and approved to achieve compliance with federal 


regulations. 


2. MO HealthNet Managed Care health plans must continue to recognize 
the need for timely submission of all required policy and procedures. The 


majority of the health plans put a tracking ormonitoring system into place 
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6. 


to ensure timely submission of documentation requiring annual approval. 
These systems must be maintained to ensure that this process remainsa 
priority forall health plans 


MO HealthNet Managed Care health plans identified the need for 
continuing to monitor provider availability in theirown networks. Although 
most health planshad the number of primary care providers (PCPs) and 
specialists required to operate, they admitted that many of these PCPs 
had closed panelsand would not accept new patients. Ensuring that 
there is adequate access forall members, including new members, should 
be a priontty forall health plans. 


MO HealthNet Managed Care health plansidentified improvement in 
their Quality Assessment and Improvement programs, and how this 
enhanced their ability to provide adequate and effective services to 
members. These efforts must be relentlessly continued to ensure that the 
organizations remain aware of areas for growth and improvement. These 
efforts ensure that the quality, timelinessand accessto care required for 
member services is maintained at an exceptional health plans continued 


to struggle with recruitment of certain specialty physicians. 


MO HealthNet Managed Care health plans identified the need for 
additional dental providers. Recruitment was largely delegated to 
subcontractors. Becoming actively involved in recruitment activities 


would benefit members and improve the quality of and accessto car. 


The use of data for quality improvement purposesand examination of 
healthcare outcomes hasincreased dramatically. Continued growth in 
the utilization of all of the data available to drive healthcare practice and 


initiatives is required to improve quality and accessto care. 
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The remaining sections of the 2007 EQRO report summarize health plan specific 
methods, procedures, findings, and recommendations for improving the quality, 
timeliness, and accessto care forthe MO HealthNet Managed Care Health Plan 
members. Please referto the main report fordetailed technical objectives, 
methods and presentation of data that are referenced here foreach MO 
HealthNet Managed Care Health Plan. 


Blue ADVANTAGE’ @9 


6.1 Performance Improvement Projects 


METHODS 
DOCUMENT REVIEW 
Blue-Ad vantage Plus supplied the following documentation for review: 


e NCQA Quality Improvement Activity Form: Ambulatory Follow-Up after 
Hospitalization for Mental Health Disorders for BA+Members 

e NCQA Quality Improvement Activity Form: Training Education and 
Restructuring the Work Flow of Member Grievancesand Appeals, and 
Provider Complaints, Grievances, and Appealsto Improve the Response 
Time to Members and Providers. 


INTERVIEWS 

Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on J uly 23, 2008 during the on-site 
review at the Kansas City, Missouri offices. Interviews included the following: 


J udy Brennan - Director State Programs BA+, Plan Administrator 
Wes Wadman - Special Programs Coordinator 

Tylisa Wyatt - Complaint Analyst 

Cheryl Banks - Manager, Quality Performance Measurement 
Lisa Woodring - Senior Director, Care Management NDBH 

Don Howard - New Directions Behavioral Health 

Garth Smith - New Directions Behavioral Health 

Shelly Bowen - Assistant Vice President Quality Management 
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Interviewees shared information on the validation methods, study design, and 
findings. Technical assistance regarding study design and presentation of 
findings was provided by the EQRO. The following questions were addressed: 


What study questions were used? 

What instruments were used fordata collection? 

How were the accuracy, consistency, and validity assured? 

What interview instruments were used? 

Why were the projects valid for continuation and used as PIPs for this 

project year? 

e What findings were relevant to the MO HealthNet managed care 
population? 

e How wasimprovement analyzed? 

e What are the conclusions about the effectiveness of the interventions 

analyzed? 


Several questions were presented during the on-site review and the health plan 
requested time to provide additional information. This information was received 


and considered in the final validation process. 


FINDINGS 

The first PIP evaluated wasAmbulatory Follow-Up after Hospitalization for Mental 
Health Disorders forBA+Members. This project was submitted asa clinical 
performance improvement project. This clinical project focused on improving 
the number of members who complied with the HEDIS measure requiring follow- 
up services within seven (7) and thirty (30) days after hospitalization. The health 
plan identified thisasa problem based on the results of their prior years’ HEDIS 
reviews. Revised information provided the basis formaking the choice to 
embark on this project. Thisdecision was based on HEDIS/NCQA standards and 
the literature review supporting the importance of compliance with timely follow- 
up care in reducing the risk of readmission to inpatient mental health treatment 
services. The study rationale is not fully developed integrating local issues and 


the study research sted. 


The study choice is supported asa relevant area of clinical care. How the study 
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relates to issues relevant to Blue-Advantage Plus membersis not well defined. 
This may meet the requirements foran NCQA study. It doesnot meet the EQR 
protocol requirements. All enrollees between the agesof sixand 65 were 
included in this tudy. No members were excluded based on the need for 


special healthcare services. Why this population is specified is not delineated in 


the narative. 
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The study question submitted was, “Will follow-up care and coordination with 
members who are discharged from inpatient care increase the rate of follow-up 
through ambulatory appointments within seven and 30 days.” The concept of 
follow-up care and coordination isnot described in a measurable terminology. 
However, in the study indicators, these measuresare defined. Baseline 
information and goals forachievement are not presented. It should be noted 
that the health plan states that they use a HEDISlike measurement 
methodology. The measurements are based on and defined by the HEDIS 
requirement; however, they are collected quarteny allowing forobtaining data 
more frequently and meeting protocol standards. 

The study did present cleany defined indicators that were measurable. 
Information provided defined the numeratorsand denominators that would be 
used to calculate success. The indicators were directly based on the HEDIS 
methodology. Due to inconsistencies in obtaining HEDIS data from the 
Behavioral Health Organization, or subcontractor providing these services, a 
“HEDIS-like” measurement was developed to compare to the actual HEDIS 
statistics gathered. The HEDISlike measure utilized the technical specifications of 
what and how to measure the follow-up rates. The data from this quarterly 
measure will be analyzed and compared to the actual certified HEDISdata 
when it becomesavailable on an annual bass. Detailed demographic 
characteristics were presented in the narrative. The documentation noted that 
no portion of the population was excluded from the study. The focus of this study 
includes Blue-Advantage Plusmembers only. The indicators measured the 


occurence of timely adherence to aftercare plans. 


The population included in the study are all members, ages6 through 65 witha 
HEDIS qualifying diagnosis, discharged from inpatient psychiatric treatment 
during each study year. The health plan used the HEDIS specifications in defining 


this population. No sampling wasused to determine who would be included. 


The data sourcesdescribed were specific. The additional information received 
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explained the methodology fordata collection. The sources of data included 
claimsand encounter data that are sampled ona yearly basis. Quarterly runs 
were also to occurand were updated in each consecutive quarter. The details 
of these sources were provided with adequate detail to produce confidence in 
their reliability and validity. The methodology remained constant across all time 
periods studied. The data included information exclusive to MO HealthNet 


managed care members. 


Gee Performance Management Solutions Group 288 


jalutions Gr 


—— — A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 6 
Report of Findings - 2007 Blue-Advantage Plus of Kansas City 
The data collection and analysis plansincluded a detailed definition regarding 
how the HEDIS and HEDIS like methodologies were to be used for intemal 
monitoring of the follow-up service compliance. This explanation includesa 
narrative explanation of the case management process to be employed to 
improve this measure. An in-depth data analysis plan was detailed in the 
documentation including a plan for quantitative and qualitative analysis. This 


plan provided information on how results would be presented and compared. 


The information provided did include data representing the baseline data, 
1/1/05 through 12/31/05, for each intervention, and the results of one follow-up 
period, which was 1/1/06 through 12/31/06. HEDISlike data wasincluded forthe 
periods form 01/01/07 to 09/30/07. Improvement was identified although the 
stated goals of the project and comparison benchmarks were not met 


throughout this period. 


The interventions utilized and the bamiersto success were documented in great 
detail. Interventions, bamiers, and opportunities for improvement were included 
for both facility issues and member issues. A discussion of methodsor plans to 
improve orenhance these interventions to obtain a more successful outcome 
wasnot included. The information included did provide confidence that this 
project could have substantive impact on memberscompliance with obtaining 


the follow-up care required aftera hospitalization for mental health services. 


The second PIP evaluated was “Appeals Process Compliance Performance 
Improvement Project.” Thiswasa non-clinical project. The decision to choose 
this study topic was supported by information provided regarding the MO 
HealthNet Managed Care Organization compliance with SMA contract 
requirements. The rationale presented wasthorough and cleany based on the 
need to respond to member gnevance and appeal requests in a timely fashion. 
The argument was presented that responding to grievance and appeals issues 
timely and efficiently decreased the delay in accessto care. The need for 
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improvement was explained in the narrative and wassupported by review of 
MO HealthNet Managed Care health plan prioritized performance expectations 
and the results of the actual performance in thisarea. The narrative information 
effectively made the argument that this non-clinical approach toa 

performance improvement project was focused on improving the key aspects of 


member services. 
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The information supporting this PIP stated that “by improving the response time of 
member grievancesand appeals, and provider complaints, grievances, and 
appeals. It provides the opportunity forthe members and providers to make 


timelier health care decisions.” 


The study question for this project was, “Will reviewing and revising the workflow 
and processes of complaints management, and educating appropnate staff, 
improve the complaints response time to members and providers?” The study 
question is well constructed and conveys the intent of the project. The indicators 
were discussed in detail and were based on the factors that created 
compliance forclosing member gnevancesand appeals, or provider 
complaints, gievancesand appeals within the required timeframe as included 
in the SMA contract. The goal wasto obtain 100% compliance foreach of the 
six indicators included in this project. The indicators were constructed to 
measure timely resolution for each step in the grievance and appeal process. 
The narrative did associate this goal with improved member outcomes. The 
population includesall members and providers who file gievancesand appeals. 


No group of the member population is excluded. 


The study design specified what data isto be collected and how this will occur. 
The health plan will use information generated by their FACETS system. This 
system includes the utilization management aspect of the health plan 
responsibilities. It also generates and tracks information to health plan staff, 
including the required Notice of Action letters. This system provides quick access 
to member information. The information provided ensured that all data in this 
system wasvalid and reliable. The FACETS database created quarterly reports 


on the indicators, including dates, reason, and notice of action outcomes. 


A baseline methodology was provided and included pertinent measures for 
each indicator. A detailed data analysis plan was part of thisdocumentation. 
This plan explained all data to be extracted from FACETS, and how it would be 
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entered into tablesto document numeratorand denominators. Statistical 
testing foreach measurement penod wasdescribed. The ztest will be utilized in 
compiling the results from this project. The narative included a description of 


the quantitative and qualitative analysis conducted as part of the study process. 
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Interventions described included: 


e training forsubcontractors, customer service staff, and state program 


sta ff; 

e the development of desk references for proceduresand requirements; 
and 

e management training regarding the timeframesand requirements of the 
NOA letters. 


A description of the bamiers to successwasprovided. Causesand possible 


solutions were also described. 


The findings for one year post baseline were included. A detailed analysis of the 
data wasprovided in the narrative. The analysisdescribed the measures where 
the goals were met, and those that indicated improvement, but had not yet 
reached the desired outcome. Thisanalysis provided a discussion about baniers 
in reaching the desired goals. Enhancements to improve these interventions 
were also described. The analysis identified initial and repeat measurements, 
statistical significance, and intemal and extemal validity. 


This study has potential for producing credible findings. The four re-measurement 
cycles included in the information presented covered the first year post baseline, 
and three quarters in the following year using HEDIS-Like measures, in which these 
interventions were implemented. The information presented described the 
effectiveness of the intervention with regard to the actionscompleted through 
this period. The impact on members wasnot part of the conclusions about the 
success of the project. However, with the improvements that were identified to 
date, it can be inferred that member serviceshave improved. This project isnot 
complete, but doesindicate significant potential forsuccess. Sustained 
improvement could not yet be determined. The format used to document the 
study findings was greatly improved compared to the original submission. The 
narrative included a detailed explanation about the process of developing the 


projectand the activities that had occured. 
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CONCLUSIONS 


QUALITY OF CARE 

These PIPs focused on creating quality and adequate services to members in 
both the clinical and non-clinicalapproach. A quality approach to assisting 
members, educating membersand facilities, and improving intemal processes 
were evident throughout the documentation provided forboth PIPs. By 
including an active case management process to assist any member who had 
inpatient mental health treatment, the quality of life and approach to providing 
services were an obviouscomponent forthe clinical PIP. Continued training and 
process improvement were evident throughout the non-clinical PIP. In both 
projects the health plan sought to improve the quality of services, orthe quality 


of intemal work, which will result in improved member care. 


ACCESS T0 CARE 

Both Performance Improvement Projects submitted by the health plan had a 
focus that addressed improved accessto health care services. The first PIP, 
regarding improved compliance with obtaining mental health aftercare 
services, exhibited a clear understanding that accessto these services was 
essential to assisting members in achieving positive mental health outcomes. 
Efforts were made to ensure that members had access to the type and amount 
of services required aftertheirinpatient stay. By addressing both inpatient facility 
bamiers, aswellas member constraints, the health plan made a concerted effort 


to improve access formemberss. 


The non-clinical PIP, focused on improving response time in the grievance and 
appeal process, and also included a focuson accessto appropnate healthcare 
services. By ensuring that the health plan system itself did not create barriers to 


members getting the health care servicesneeded, accessis improved. 
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TIMELINESS OF C ARE 

Both projects had a distinct focus on timely and adequate care. In the first PIP 
regarding follow-up care after inpatient mental health treatment, the health 
plan sought to ensure that members obtained outpatient treatment within the 
seven and thirty day time frames required by NCQA standards. In the second 

PIP regarding improving the gnevance and appeal process there was attention 
to timely processing and decision making to assure that the services needed by 
the member could be delivered in a timely fashion. The focus of both projects 
were to ensure that the most timely care be available to members, and to 


ensure that intemal processes or other bamiers did not hinder thisoutcome. 


RECOMMENDATIONS 
1. The narativesdid not include discussion on how the PIP processcan be 
enhanced to improve outcomes based on the bamiers and opportunities 
recognized to create improved outcomes. Conclusions were drawn 
based on the data that wascurently available. However, next steps 
were not articulated in the information available. The inclusion of this 
information would ensure that the plan forthese ongoing PIPS was 


clarified. 


2. Continue using the expanded written format made available in the 
additional information submitted and in the information provided after the 
on-site review to communicate the intentions, planning, and processes 


utilized in developing and implementing the PIPs. 


3. Utilize the Conducting Performance Improvement Project protocol to 


assist in the process of project development and reporting. 
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6.2 Validation of Performance Measures 


METHODS 

This section describes the documents, data, and persons interviewed forthe 
Validation of Performance Measures for Blue-Advantage Plus of Kansas City. 
Blue-Ad vantage Plus of Kansas City submitted the requested documents on 
January 29, 2008. The EQRO reviewed documentation between J anuary 29, 
2008 and J uly 1, 2008. On-site review time was used to conduct follow-up 
questions and provide feedback and recommendations regarding the 


performance measure rate calculation. 


DOCUMENT REVIEW 
The following are the documents reviewed by the EQRO: 


e The Baseline Assessment Tool (BAT) submitted by Blue-Advantage Plus of 
Kansas City 

e Emst & Young’s NCQA HEDIS 2007 Compliance Audit Report 
Letters of Communication between the EQRO and Blue-Advantage Plus of 
Kansas City 

e Blue-Advantage Plus of Kansas City policies pertaining to HEDIS 2007 rate 
calculation and reporting 

e Blue-Advantage Plus of Kansas City Information Services (IS) policies on 
disaster recovery 

e Blue-Advantage Plus of Kansas City’s HEDIS implementation work plan 
and HEDIS committee agendas for 2007 
Data warehouse validation procedures for the CRMS software 

e DB2 data warehouse modelsof the interim data warehouse 


The following are the data files submitted by Blue-Advantage Plus of Kansas City 
forreview by the EQRO: 


ADV Denominator.txt 

ADV Enrollment.txt 

ADV Numerator.txt 

AWC FROM REPOSITORY. txt 
AWC_resubmit for audit_2006.txt 
FUH DENO MINATOR.txt 

FUH ENRO LLM ENT. txt 

FUH NUMERATOR 7 DAYS.txt 

FUH NUMERATOR 30 DAYS.txt 
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INTERVIEWS 

The EQRO conducted on-site interviews with Michelle Williams, Senior Health 
Data Analyst and Cheryl Banks, UM Training and Compliance Manager at Blue- 
Advantage Plus of Kansas City in Kansas City, MO on Wednesday, J uly 23, 2008. 
This group wasresponsble for calculating the HEDIS performance measures. The 
objective of the vist was to verify the data, methods, and processes behind the 
calculation of the three HEDIS 2007 performance measures. Thisincluded both 
manual and automatic processes of information collection, storing, analyzing, 


and reporting. 


FINDINGS 

Blue-Ad vantage Plus of Kansas City used the Administrative Method for 
calculation of the HEDIS 2007 Adolescent Well-Care Visits, Follow-Up After 
Hospitalization for Mental Illness, and Annual Dental Visits measures. MO 
HealthNet Managed Care health plan to MO HealthNet Managed Care health 
plan comparisons of the rates for Adolescent Well-Care Visits, Follow-Up After 
Hospitalization for Mental Illness, and Annual Dental Visits were conducted using 
two-tailed z-tests. For comparisons that were statistically significant at the 95% 
confidence interval (Cl), the z-score (z), the upperand lowerconfidence 


intervals (Cl), and the significance levels (p <.05) are reported. 


The reported rate for Blue-Advantage Plus of Kansas City for the HEDIS 2007 
Adolescent Well-Care Visits measure was 31.54%, significantly lowerthan the 
statewide rate for MCHPs (34.81%; z =-0.33, 95% Cl: 28.89%, 40.74%; p <.05). This 
reported rate isa Sight increase overthe rate (31.20%) reported by this health 
plan in the 2004 EQR report. 


The reported rate for Blue-Advantage Plus of Kansas City for the HEDIS 2007 
Follow-Up After Hospitalization for Mental Illness measure was 58.67% for the 7- 
day rate, significantly higherthan the statewide rate for all MC HPs (35.52% z =- 
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0.34, 95% Cl: 22.96%, 48.08%; p > .95); this rate is significantly higher than the 7 - 
day rate (50.17%) reported by the health plan in the 2006 EQR report. The 
reported rate was 76.00% for the 30-day rate, also significantly higherthan the 
statewide rate for all MCHPs (60.06%; z = 1.38, 95% Cl: 47.50%, 72.62% pp >.95); this 
rate wasalso significantly higherthan the 30-day rate (72.76%) reported by the 
health plan in the 2006 EQR report. 
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The HEDIS 2007 combined rate for Annual Dental Visits reported by Blue- 
Advantage Plus of Kansas City was 33.72%, comparable to the statewide rate for 
MC HPs (32.50%, z =0.04; 95% Cl: 29.30%, 35.69%; n.s.). This reported rate isa slight 
increase overthe rate (31.79%) reported by this health plan in the 2005 EQR 
report. 


The following sections summanze the findings of the processfor validating each 
of the performance measures in accordance with the Validating Performance 
Measures Protocol. The findingsfrom all review activities are presented 
according to the EQRO validation activity, with the findings foreach measure 
discussed within the activitiesasappropnate. Please referto the tablesin the 


main report for activities, ratings, and comments related to the Attachments. 


DATA INTEG RATION AND CONTROL 

Blue-Advantage Plus of Kansas City used a NCQA-certified vendor application 
(MedMeasures) forcalculation of rates forthe HEDIS 2007 measures. The EQRO 
was given a demonstration of the data flow and integration mechanisms for 
extemal databases for these measures, and provided with a layout of the data 
structure of the intemally-developed data warehouse for storing interim data. 
Forthe three measures calculated, Blue-Advantage Plus of Kansas City was 
found to meet all criteria for producing complete and accurate data (see 
Attachment V: Data Integration and Control Findings). There were no biases or 
errors found in the manner in which Blue-Ad vantage Plus of Kansas City 
transferred data into the repository used for calculating the HEDIS 2007 measures 
of Adolescent Well-C are Visits, Follow-Up After Hospitalization for Mental Illness, 


and Annual Dental Visits. 


DOCUMENTATION OF DATA AND PROCESSES 
Data and processes used forthe calculation of measures were adequate (see 


Attachment Vil: Data and Processes Used to Calculate and Report Performance 
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Measures). Blue-Advantage Plus of Kansas City met all criteria that applied for 
the three measures validated. Blue-Advantage Plus of Kansas City did utilize 
statistical testing; BA+ continues to partner with Emst & Young to best assess how 


to utilize the information that they obtain from the statistical analysis process. 
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PROCESSES USED TO PRODUCE DENOMINATORS 

Blue-Ad vantage Plus of Kansas City met all criteria forthe processes employed to 
produce the denominators of the performance measures validated (see 
Attachment X: Denominator Validation Findings). Thisinvolvesthe selection of 
eligible members for the services being measured. Denominators in the final 
data files were consistent with those reported on the DST forthe three measures 
validated. All members were unique and the datesof birth ranges were valid. A 
total of 4,613 members eligible were reported and 4,613 were validated forthe 


Adolescent Well-C are Visits measure. 


There were 225 eligible members reported forthe denominator of the Follow-Up 
After Hospitalization measure, 225 were validated. There were 14,138 eligible 
members reported and validated forthe denominator of the Annual Dental Visit 


measure. 


PROCESSES USED TO PRODUCE NUMERATORS 

The measures validated included the appropriate data ranges for the qualifying 
events (e.g., well-care visits, follow-up visits and dental visits) asspecified by the 
HEDIS 2007 criteria (Attachment Xill: Numerator Validation Findings). 


For the HEDIS 2007 Adolescent Well-Care Visit measure, there were a total of 
1,455 administrative hits reported by Blue-Advantage Plus of Kansas City and 
1,452 validated by the EQRO. The rate validated by the EQRO for Adolescent 
Visits was 31.48%, an observed bias of 0.07% 


The Follow-Up After Hospitalization for Mental Illness measure is reported in both 
7-day and 30-day rates. The number of administrative hits reported forthe 7-day 
rate was 132; 130 of these hits were validated by the EQRO. The reported 7-day 
rate was 58.67% The EQRO validated rate was 57.78%, an observed bias of 
0.89%. For the 30-day calculation, the reported number of hits was 171 with 170 
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of these validated by the EQRO. The rate reported forthe 30-day calculation 
was 76.00% and the EQRO validated rate was 75.56%, an observed bias of 0.44%. 
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The number of hits reported forthe combined rate for Annual Dental Visit was 
4,768; 4,761 were validated by the EQRO. The reported rate was 33.72% and the 


validated rate was 33.68%, an observed bias of 0.05%. 


No sampling or medical record reviews were conducted orvalidated forthe 
performance measures validated. CMS Protocol Attachment XIl; Impact of 
Medical Record Review Findings and Attachment XV: Sampling Validation 
Findings do not apply to the Administrative Method. 


SAMPLING PROCEDURES FOR HYBRID METHODS 

No medical record reviews were conducted orvalidated. CMS Protocol 
Attachment XIl; Impact of Medical Record Review Findingsand Attachment XV: 
Sampling Validation Findingsdo not apply to the Administrative Method. 


SUBMISSION OF MEASURES TO THE STATE 

Blue-Ad vantage Plus of Kansas City submitted the DST forall three measures 
validated to the SPHA (the Missourn Department of Health and Senior Services: 
DHSS) in accordance with the Code of State Regulations (19 CSR § 10-5.010 
Monitoring Health Maintenance Organizations) and the SMA Quality 


Improvement Strategy. 


DETERMINATION OF VALIDATION FINDINGS AND CALC ULATION OF BIAS 

Asnoted earlier, some bias wascalculated in the HEDIS 2007 Adolesc ent Well- 
Care Visits, Follow-up After Hospitalization for Mental Illness, and Annual Dental 
Visits measures evaluated; all three of these measures were overestimated. 
However, the biasobserved wasminimal (lessthan 1%in each case). The rate 
validated foreach measure fell within the 95% confidence interval reported by 
the MCHP for that measure. 
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Table 47 - Estimate of Bias in Reporting of BA+ HEDIS 2007 Measures 
Direction of 
Estimate of Bias | Estimate 
Adolescent Well-Care Visits 0.07% Overestimate 


Follow- Up After Hospitalization (7 days) 0.89% Overestimate 
Follow-Up After Hospitalization (30 days) 0.44% Overestimate 
Annual Dental Visit 0.05% Overestimate 





FINAL AUDIT RATING 
The Final Audit Rating foreach of the performance measures was based on the 
findings from all data sources that were summanzed in the Final Performance 


Measure Validation Worksheet foreach measure. 


Table 48 - Final Audit Rating for BA+ Performance Measures 
Measure Final Audit Rating 


Adolescent Well-Care Visits Sub sta ntia lly Compliant 
Follow- Up After Hospitalization (7 days) Sub sta ntia lly Compliant 
Follow-Up After Hospitalization (30 days) Substantially Compliant 


Annual Dental Visit Sub sta ntia lly Compliant 


Note: Fully Compliant =Measure was fully compliant with State specifications; Substantially 
Compliant =Measure was substantially compliant with State specifications and had only minor 
deviations that did not significantly biasthe reported rate; A significant biasin the rate was defined 
asa numbercalculated by the EQRO that fell outside the 95% confidence interval of the rate 
reported by the health plan. Not Valid =Measure deviated from State specifications such that the 
reported rate wassignificantly biased. Thisdesignation is also assigned to measures for which no 
rate wasreported; Not Applicable =No MO HealthNet Managed Care Members qualified forthe 
measure. 











CONCLUSIONS 

Four rates were validated forthe health plan. One of these rates was consistent 
with; two were significantly higher than; and one was sgnificantly lower than the 
average forall MO HealthNet Managed Care health plans. 


QUALITY OF CARE 
Blue-Advantage Plus of Kansas City’s calculation of the HEDIS 2007 Follow-Up 


After Hospitalization for Mental Illness measure was substantially complaint with 
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specifications. This measure iscategonzed asan Effectiveness of Care measure 
and is designed to measure the effec tiveness/ quality of care delivered. The 
health plan’s 7-day and 30- day follow-up reported rates were both significantly 
higher than the average rate forall MO Health Net Managed Care health plans, 
aswell as being higher than both the National Medicaid Average and the 
National Commercial Average. The health plan is delivering a level of care 
higher than that received by both the average MO HealthNet Managed Care 
member in Missouri and the average Medicaid or Commercial member across 
the nation. Both of these rates were also significantly higher than the same 
measure rates reported in last yearsEQR report. The plan’s focus on this 


measure is evident in the results they have achieved in these rates. 


The EQRO wasable to validate this rate within the reported 95% confidence 


interval and therefore has substantial confidence in the calculated rate. 


ACCESS TO CARE 

The Annual Dental Visit rate for Blue-Advantage Plus of Kansas City was 
substantially compliant with specifications; this measure iscategonzed asan 
Effectiveness of Care measure. Because only one vist is required fora positive 
“hit”, this measure effectively demonstrates the level of accessto care that 
membersare receiving. The rate validated forthe health plan wascomparable 
to the overall rate calculated forall MO Health Net Managed Care health plans. 
Blue-Ad vantage Plus of Kansas City’s membersare receiving a level of care 
consistent with that received by the average MO HealthNet Managed Care 
memberin Missour. Thisrate isa sight increase overthe rate reported forthe 
2005 EQR report (the last year this measure was audited by the EQRO). 


The EQRO wasable to validate this rate within the reported 95% confidence 


interval and therefore has substantial confidence in the calculated rate. 
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TIMELINESS OF C ARE 

The health plan’s calculation of the HEDIS 2007 Adolescent Well-Care measure 
was substantially compliant. This measure iscategorized asa Use of Services 
measure and isdesigned to measure accessto and timeliness of the care 
defined. The health plan’s reported rate forthis measure was significantly lower 
than the average acrossall MO Health Net Managed Care health plans. 
Therefore, Blue-Advantage Plus of Kansas City’s members are receiving less 
access to and timeliness of care for this measure than the average MO 


HealthNet Managed Care members. 


The EQRO wasable to validate this rate within the reported 95% confidence 


intervals and thereby has substantial confidence in the calculated rate. 
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RECOMMENDATIONS 

1. Blue-Advantage Plus of Kansas City should utilize hybrid methods where 
HEDIS specifications recommend using the hybrid approach. 

2. Continue work with Emst & Young to conduct and document statistic al 
comparisons on rates from yearto year. 

3. The health plan’s rate forthe Adolescent Well-Care Visits measure was 
significantly lowerthan the average rate forall MO HealthNet Managed 
Care health plans. The EQRO recommends the health plan concentrate 
efforts to improve this rate. 

4. Allfourof the ratesvalidated by the EQRO showed an increase over the 
prior yearscoresponding rates. The EQRO recommends that the health 
plan continue to monitor trending in rates from yearto yearand 
responding to those trends by increasing efforts for those rates that do not 


increase oronly increase slightly. 
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6.3 Validation of Enc ounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical elds? 


Forthe Medical claim type, there were 84,357 encounter claims paid by the SMA 

forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete, accurate 
and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete, accurate 
and valid. 

5. The Outpatient Units of Service field was 100.00% complete, accurate and 
valid. 

6. The Outpatient Procedure Code field 100.00% complete, accurate and valid. 

7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. The second through fifth Diagnosis Code fields are optional according to the 
Health Plan Record Layout Manual. Each of these Diagnosis Code fields fell 
well below the 100% threshold established by the SMA for this validation. The 
second, third, fourth and fifth Diagnosis Code fields were 49.5%, 22.79%, 
12.24%, and 0.00% complete, accurate and valid, respectively. The 
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remaining fields were blank (incomplete, inaccurate, and invalid). 


Forthe Dental claim type, there were 8,408 encounter claims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. All of the fields examined 


were 100.00% complete, accurate and valid. 
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Forthe Home Health claim type, there were 23lencounter claims paid by the 
SMA forthe period J uly 1, 2007 through September 30, 2007. All of the fields 
examined were 100.00%complete, accurate and valid except the Procedure 
Code and second through fifth Diagnosis Code fields. The Procedure Code field 
was 79.22% complete and accurate and valid. The remaining fields (n =48) 
were blank. The second, third, and fourth Diagnosis Code fields were 26.84%, 
18.61%, 5.63% and 1.73%complete, accurate, and valid, respectively. All 


remaining fields were blank (incomplete, inaccurate, and invalid). 


For the Inpatient claim type, there were 11,582 encounter claims paid by the 

SMA forthe period J uly 1, 2007 through September 30, 2007. 

1. The Inpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Recipient ID field was 100.00% complete, accurate and valid. 

3. The Admission Type field was 100.00% complete, accurate and valid. 

4. The Admission Date field was 100.00% complete, accurate and valid. 

5. The Discharge Date field was 100.00% complete and 99.57% accurate and 
valid (with 50 entries of “99999999”). 

6. The Bill Type field was 100.00% complete, accurate and valid. 

7. The Patient Status field was 100.00% complete, accurate and valid. 

8. The first Diagnosis Code field was 99.99% complete, accurate and valid. The 
remaining fields (n=77) were blank (incomplete, inaccurate and invalid). 

9. The second, third, fourth, and fifth Diagnosis Code fields fell well below the 
100% threshold for completeness, accuracy, and validity established by the 
SMA (86.9%, 69.72%, 57.56%, and 43.77%, respectively). The remaining fields 
were blank (incomplete, inaccurate, and invalid). 

10. The First Date of Service field was 100.00% complete, accurate and valid. 

11. The Last Date of Service field was 100.00% complete, accurate and valid. 

12. The Revenue Code field was 99.76% complete, accurate and valid. There 
were four (27) blank fields. 


13. The Units of Service field was 100.00% complete, accurate and valid. 
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For the Outpatient Hospital claim type, there were 36,071 encounter claims paid 
by the SMA forthe period J uly 1, 2007 through September 30, 2007. All fields 
examined were 100.00% complete, accurate, and valid except for the 
Procedure Code and second through fifth Diagnosis Code fields. The Procedure 
Code fields were 97.69% complete and accurate. The remaining fields were 
blank (n =833). The Procedure Code fields were 97.62% valid with incormect 
codes (n=26). The second, third, fourth and fifth Diagnosis Code fields fell well 
below the 100% threshold for completeness, accuracy, and validity established 
by the SMA (58.23%, 31.28%, 15.80% and 8.69%, respectively). The remaining 


fields were blank (incomplete, inaccurate, and invalid). 


Forthe Pharmacy claim type, there were 37,963 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. All fields examined were 


100.00% complete, accurate and valid. 


What Types of Enc ounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for Blue-Advantage Plus of Kansas 
City, an error analysis of the invalid entries was conducted for fields which were 
lowerthan the 100.00% threshold specified by the SMA. Dental, Outpatient 
Medical, and Pharmacy claim type critical fields examined were 100.00% 
complete, accurate, and valid. ForHome Health claims, the Procedure Code 
field contained some invalid data. The Discharge Date fields for the Inpatient 


claim type contained some invalid codes. 


What is the Level of Volume and Consistency of Servic es? 
When companing the rate of encounter claim types per 1,000 members, Blue- 
Advantage Plus of Kansas City demonstrated rates consistent with the average 


forall MCHPs forthe Outpatient Hospital, Pharmacy and Dental claim types; and 
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a significantly higher rate for Home Health and Inpatient encounter claims. 

These findings suggest moderate to high accessto care for Outpatient Hospital, 
Pharmacy, Dental, Inpatient and Home Health Care services for Blue-Advantage 


Plus of Kansas City members. 


To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each MCHP were randomly 
selected from all claim types for the period J uly 1, 2007 through September 30, 


2007 for medical record review. 


Of the 178,612 encounter claim typesin the SMA extract file forJ uly 1, 2007 
through September 30, 2007, 100 encounters were randomly selected. Providers 
were requested to submit medical records for review. There were 97 medical 
records (97.0%) submitted for review. Encounters for which no documentation 
was submitted were unable to be validated. The match rate for procedures was 
52.0%, with a fault rate of 48.0%. The match rate for diagnoses was 59.0%, with a 
fault rate of 41.0% 


What Types of Errors Were Noted? 

An enor analysis of the errors found on the medical record review for procedure 
and diagnosis, wasconducted. Forthe diagnosis code in the medical record, 
the reasons for diagnosis codesnot matching the SMA extract file were missing 
information (n =32) and incorect code found (n=9). Forthe procedure code in 
the medical record, the reasons for procedure codesin the SMA extract file not 
being supported by documentation in the medical record were missing 
information (n =29), incorrect code (n=8), downcoded (4) and upcoded (7). 
Examples of missing information included no code; codeslisted that were not 


supported, or codesthat did not match the procedure description. 
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To what extent do the MO HealthNet MC HP paid/ unpaid enc ounter claims match 
the SMA paid database? 

Since Blue-Advantage Plus of Kansas City included intemal control numbers that 
matched those of the SMA, the EQRO conducted the planned analyses 
comparing MCHP encounter data to the SMA encounter claim extract file. The 
SMA defined “unpaid claims” asthose claimsthat the MCO denied for payment, 


unpaid claimsdo not include claims paid via a capitation plan. 





Forthe Pharmacy Claim type, all encounterdata submitted to the EQRO (n= 
37,963) wasof “paid” status. There were 0 unmatched claims that were in the 
BA+encounter file and absent from the SMA data. Thus, 100.00% of the EQRO 


submitted encounters matched with the SMA encounter records. 
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Forall Outpatient Claim Types (Medical, Dental, and Hospital), 128,836 “paid” 
encounters 37 “denied” and 68 “unpaid” claims were submitted. All paid 
encounter claims matched with the SMA encounter claim extract file. The 37 
denied claims and 68 unpaid claims were not present in the SMA database (as 
expected); there wasa “hit” rate of 99.99% between BA+ encounter claims and 


the SMA encounterdata. 


For the Inpatient Claim Type, BA+submitted 11,582 encounter claims of “paid” 
status and 55 “denied” and 1 “unpaid” claims. All paid encounterclaims 
matched with the SMA encounter claim extract file. The denied and unpaid 


claims were not present in the SMA database. 


Why are there unmatched claims between the MCHP and SMA data files? 
The unmatched encounters are due to missing ICN numbers which are required 
to match the encounterto that of the SMA. Therefore, in all claim types, the 


encounter claims were legitimately missing from the SMA extract data. 


What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 


While the MO HealthNet Managed Care health plan did submit the data in the 
requested format (including most ICN numbers), there are a numberof ways to 
improve the data quality by improving the database system. Asthe Intemal 
Control Numberis only assigned by the State database when a claim is paid, it is 
diffic ult to match the MO HealthNet Managed Care health plan data of 
“unpaid” and “denied” claimsto the SMA data. Asthe Intemal Control Number 
is unique only to the encounter, the ICN may be represented in multiple lines of 
data. To match the MO HealthNet Managed Care health plan data to the SMA 
data to specific fields, this requires a unique line number. Therefore each service 


provided within an encounter would have a separate line of data with a unique 


line identifier. 
Ce=— Performance Management Solutions Group 317 
ere A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 6 
Report of Findings - 2007 Blue-Advantage Plus of Kansas City 


Performance Management Solutions Group 318 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 6 

Report of Findings - 2007 Blue-Advantage Plus of Kansas City 

CONCLUSIONS 

STRENGTHS 

1. Encounterdata wassubmitted to the EQRO in the requested format which 
allowed encounter validation forall claim types. 

2. The critical field validation of all six claim types resulted in few fields under the 
SMA established threshold of 100.00% accuracy, completeness, and validity. 

3. The critical fields evaluated forthe Dental, Outpatient Medical and 
Pharmacy claim types were 100.00% complete, accurate, and valid. 

4. The rate of Home Health and Inpatient encounter claims was significantly 
higher than the average forall MO HealthNet Managed Care health plans. 


AREAS FOR IMPROVEMENT 

1. Forthe Home Health claim type, the Procedure Code fields contained invalid 
entries. 

2. Forthe Inpatient claim type, there were invalid datesin the Discharge Date 
fields; also there were blank Revenue Code fields. 

3. The Outpatient Procedure Code field in the Hospital claim type contained 
invalid fields. 

4. The rate of Inpatient encounter claims was significantly lower than the 


average forall MO HealthNet Managed Care health plans. 


RECOMMENDATIONS 

1. Examine and revise asneeded intemal system edits for invalid procedure 
codes in the UB-92 file layout for the Outpatient Procedure Code and 
Discharge Date fields 


2. Run validity checksafter the programming of new edits. 
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6.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Priorto the site visit, documentation was received and reviewed regarding the 
MO HealthNet Managed Care Health Plan’scompliance with the State 
contract. The Extemal Quality Review Organization (EQRO) reviewed contract 
requirements with the staff of the MO HealthNet Division (MHD). This ensures that 
documentation isdeveloped and practices occur within the scope of the 


contract and ina mannerthat meets or exceeds federal regulations. 


A detailed protocol (BHC MO HealthNet Managed Care Health Plan 
Compliance Review Scoring Form) was utilized to ensure that all the elements of 
the federal regulations were addressed in the review process. Document 
reviews occuned on-site to validate that practicesand procedures were in 


place to guide organizational performance. 


On-site review time wasused to conduct interviews with Member Services’ Sta ff 
and Supervisors, and separately with Case Management Staff and Supervisors. 
This approach wasutilized to validate that practices that occur when serving 
members. These interactionsand responses were compared to policy 
requirements to ensure that both are within the scope of the contractand are 


conducted in a manner that meets or exceeds federal regulations. 


A detailed interview tool, individualized for Member Services’ Staff and for Case 
Management staff, was utilized to ensure that all pertinent elements of the 
federal regulations were addressed in the interview process. Additionally, an 
interview tool wasconstructed foradministrative staff to validate and clarify 


these practices and to follow-up on questions raised from the interviews. 
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DOCUMENT REVIEW 
The MO HealthNet Division supplied: 

e State of Missouri Contract Compliance Tool (including MHD responsesand 


comments) 


The following documents were requested for on-site review: 
e Member Handbook 
e Provider Handbook 
e Credentialing Policiesand Audit Reports 
e Policy Tracking Log 
e Grievance LogsforMember and Providers 


e 2007 Annual Appraisal of the Quality Improvement Program 


Additional documentation made available by Blue-Advantage Plus included: 
e 2007 Marketing Plan and Educational Maternal Development Policy 
e Blue-Advantage Plus of Kansas City Organizational Chart 
e BA+Brochures - English/Spanish versions 
e 2007 Well Aware Newsletters (Member) 
e 2007 Blue Speak Newsletters (Provider) 
e 2007 BA+Policy Spreadsheet 
e BA+Report Care - 2007 


INTERVIEWS 
Interviews were conducted with the following groups: 


Plan Administration 





e Judy Brennan - Director, State Programs, Plan Administrator 
e Dr. Loretta Britton - VP, Medical Director 

e Sandy Wederquist, RN - Director, Medical Management 

e Shelly Bowen - AVP, Quality Management 
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e Tylisa Wyatt - Compliance Analyst 
e Wes Wadman - MHIP Coordinator 
e Wayne Burge - Vice President, Provider Contracting and Reimbursement 
e Dennis Radio - Director, Professional Services 
e Randy Meyer - Director, Hospital Services 


e Thutam Treu - Director, Member Services 


Member Services Sta ff 
e Thatum Trieu - Director, Member Services 
e Trish Mahunn, Supervisor, Member Services 
e Lanna Golliglee, Tech Specialist 
e Annie Magana, Claims 
e Eric Crumble, Customer Services 
e Carmen Maddox, Membership 
e Tylisa Wyatt, CGA 


Case Management Sta ff 
e Dr. Loretta Britton - Medical Director 
e Sandy Wederquist -Director, Medical Management 
e Rhonda Janky - Case Manager 


e Cindy Hochart - Population Management 


FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

Blue-Advantage Pluscontinued to exhibit commitment and enthusiasm toward 
ensuring that member rights and protectionsare in place. There wasa 
significant change in the atmosphere, which seemed to empowerthe 
administrator of the program and invite front line staff to be involved in the 


operations of the program. Members Services staff were proud of their record in 
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contacting new members quickly after the health plan leamed of enrollment. A 
variety of continued contacts are made if initial attempts failed. Written 
information was provided in English or Spanish. If additional interpretive services 


were required, this was arranged forthe member. 
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Blue-Advantage Plus made changes in a number of processes to make service 
delivery easier for members. In J anuary 2005 the health plan stopped requiring a 
primary care physician (PCP) referral for specialist care. This process continues 
and staff report that this has assisted membersin obtaining more timely health 
care. Communication is requested between physicians, with the goal of 
contact occuning between specialists and PCPs, within one day. Ifthe situation 
isan emergency the Medical Director, Dr. Loretta Britton, isinvolved. Dr. Britton 
also becomes involved if a timely appointment cannot be made. Quality 
improvement staff monitors appointment access regulary to insure that this 


important component meets all requirements. 


A complex case management program hasbeen added to the already 
available catastrophic case management program. Nurses will now get regular 
reports from the emergency roomsand from hospitals. Nurses review all 
emergency room visits within one week. Ifa visit isnot urgent, contact ismade 
with the memberto educate them on obtaining PCP care regulary and to 
provide assistance in overcoming bamiersto the member's utilization of PCP 
services. These case managersalso review claims histories to assess where 
healthcare hasbeen received. Outreach to PCPs requesting their contact with 
members to engage them in utilizing their medical home is also made. BA+is 
working with American Academy of Family Practice (AAFP) to support members 


in maintaining a medical home. 


BA+ operates the Healthy Companion program, which isan umbrella for healthy 
living initiative that includes prevention, disease management, and a relationship 
with a nurse case manager. Thisinformation and process is available to all BA+ 
members. The case manager schedules calls at the members convenience. 
Outreach additionally occurs when a problem arises, such asa negative 
laboratory report. The program includes an interface with local public health 
departments and a monitoring program fordiabeticsand members with 
hypertension. The system is also shared with New Directions Behavioral Health, 
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the health plan’s behavioral health subcontractor. Feedback is provided 
regarding the medical perspective on consultations for members with multiple 
problems. This process ensures timely access to follow-up care when referals are 
made. 
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BA+now hasaccessto more information through their data warehouse 
regarding members with special health care needs. The BA+member list is run 
through the data warehouse looking fora diagnosis if something occurs that is 
not routine. When a problem is identified, the member is referred to case 
management for follow-up contacts and services. This report is run for lead case 
management and caseSrelating to the Jackson County Consent Decree. The 
health plan utilizes the State Health Needs Assessment, which is helpful in 
identifying members who need behavioral health services, and those who are 


pregnant. 


The health plan usesa predictive modeling tool, Care Advance, to search 
through data and detect members who are at risk of needing care 
management services. Data used by the case managers included claims, 
phamacy utilization, laboratory results, and self-reported information. Follow-up 
contact with members occurs with all at-risk members detected, particulary 
those with diabetes, heart disease, and COPD. The members receive prompts 
to: make medical appointments; identify the need for chronic disease 
treatment; and to create comparisonsto best practice guidelines. The case 
managers perfomm assessments to submit to involved providers. Tutorials for 
chronic diseases, such asasthma and diabetes are available and providers will 


be able to use this information, as well as patient tracking information. 


Member Services staff report that they make welcome calls to all new members 
to review benefits and to discuss the member's medical needs. The assigned 
PCP is discussed with the memberto ensure that thisisthe provider of choice. 
Changes are made if necessary. The Member Services staff also contacts the 
PCP to ensure that the memberis in their panel and that there will be no 
problem when an appointment is sought. The Member Services staff also informs 
members of the right to transportation services, and ensures that they know how 
to request this service should it be necessary. Member Services staff disc uss 
cultural issues, if appropriate, ensure that the memberis comfortable with the 
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PCP, and ask about language or other cultural considerations. 


Case managers report that they have over fifty yearsof combined experience. 
They were able to discussall potential referral sources. Upon receipt of a new 
referral the case managersreview member claims, MOSAIC, prior authorizations, 
and any available clinical notes. The member is contacted and engaged in the 
assessment process. Case Managers explain their case management role and 
tailor their treatment plan to best meet membersneeds. Each case is assessed 
for low to high acuity, which becomesa guide for the frequency of follow-up. 
Case Managers ensure that the memberhasa medical home, if aware of 
available health care services, and other social supports that may be beneficial 
such as WIC or Food Stamps. 


Case Managers provided concrete examples of how they engage a variety of 
servicesto meet a membersneeds. One example was that of a two-yearold 
with hemophilia. The mother wasnot a memberand spoke Spanish. The case 
managercontacted her using the ATTinterpreter, and leamed that there wasa 
problem of pestsin the living arangement. The mother was experiencing 
depression related to herson’scondition. The Case Manager made a referral for 
the motherto New Directions Behavioral Health, and also to Swope Medical 
Center. A home infusion provider was engaged to see the son on ste, and 
armangements were coordinated by Jackson County Social Services forthe 


landlord to perfom frequent exterminations of the living quarters. 


The rating for Enrollee Rights and Protections (100.0%) reflects Blue-Advantages 
Plus’s ability to have all policy and procedures submitted and approved by the 
SMA in a timely manner forthe third consecutive year. The health plan provided 
evidence of their practice throughout the on-site review process. It appears that 
the health plan is in compliance with all MO HealthNet Managed Care contract 


regulations and federal requirements. 
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Table 49 - Subpart C: Enrollee Rights and Protections Yearly Comparison (BA+) 


Federal Regulation 





20052006 


438.100(a) Enrollee Rights: General Rule 2 2 2 
438.10(b) Enrollee Rights: Information Requirements 





















438.10(c)(4,5) Language and Format: Interpreter 
Services 
438.10(d)(1)(i) Information Requirements: Format/Easily 2 


2 2 2 
438.10(c)(3) Alternative Language: Prevalent Language 2 2 2 
2 2 2 


Understood 7 2 
438.10(d)(1)(ii)and (2) Information Requirements: 2 > 2 
Format Visually Impaired, and Limited Reading Proficiency 

438.10(f) Information for All Enrollees: Free Choice, etc. 2 2 2 
438.10 (g) Information to Enrollees: Specifics/Physician 2 > > 
Incentive Plans 

438.10(i) Special Rules: Liability for Payment/Cost 2 > 2 
Sharing 

438.100(b)(2)(iii) Enrollee Rights: Provider-Enrollee 2 2 > 
Communications 

438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 2 > > 
Directives 

438.100(b)(3) Right to Services 2 2 2 
438.100(d) Compliance with Other Federal/State Laws 2 2 2 
Number Met 13 13 13 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 











Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


BEHAVIORAL HEALTH 

Interviews occured at the time of the on-site review with Blue-Advantage Plus 
and administrators from their Behavioral Health Organization (BHO), New 
Directions Behavioral Health (NDBH). They reported on new programs that 


occured during 2007. 


NDBH wasasked about accuracy and timelines of claims issues, which was 
raised asan issue in theirannual report. The BHO explained that they had taken 


stepsto improve in thisarea. They now meet with provider office managers 
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quarteny and all transactionsare handled electronically. They have a broad 
network of providers, but this situation hasimproved and claims are being 
submitted and paid ina timely manner after corrective action was 


implemented. 
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New Directions Behavioral Health continued to jointly operate the Parents and 
Children Together (PACT) program with the GillisC enter. The PACTprogram has 
been in place fornine years. This program provides intensive interventions for 
members and their families, with follow-up services within the community. The 
Gillis Center now employs 26 trained therapists for this program. The BHO 
estimates that between twenty and thirty percent of members receiving sub- 
acute level care are referred for PACTservices. PACT provides direct services 
and assists the family with community resources. Forexample, the program 
connected members and their families with their Community Mental Health 

Clinic (CMHC) forwrap around services or other beneficial interventions. 
Referrals are also made to Marillac Center for coordination with school programs 
and residential placement, if thisbecomesnecessary. This service usually lasts 
only slightly longerthan average inpatient treatment stays, and avoids court- 
involved out-of-home placement. These services, exceptional to the 
requirements of the MO HealthNet Managed Care contract, assist members 
leaving in-patient care, and in some cases prevented in-patient care. Providing 
this type of support mechanism allowed the health plan to increase ambulatory 
follow-up formembess leaving in-patient services at the seven and thirty-day 


time frames. 


NDBH has continued to develop their collaborative efforts with PCPs. They 
ensure that the PCP is notified immediately ifa member enters inpatient 
treatment. Anytime there isa drug overdose reported, the BHO ensuresthat the 


PCP receives notification. 


The BHO hasdeveloped clinical guidelines that are posted on the health plan’s 
webste. These are reviewed annually by the BA+ Quality Improvement Team. 
They have also developed ADHD guidelines for providers and members. These 
are posted on the health plan’s website. They have been unable to produce 
this information at the sixth grade reading level (as required by State statute), so 


are unable to distribute to all MO HealthNet Managed Care members. 
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However, these are mailed to members any time they are requested. 
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QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT 

Access Standards 

Blue-Ad vantage Plus of Kansas City continued to have an extensive provider 
network available. The health plan reported that having regular access to 
orthopedic surgeons, neurologists and urologists was difficult. Blue-Advantage 
Plus has set up out-of-network agreements with orthopedic surgeonsat Truman 
Medical Center forhand surgery. Three urologists from the Kansas City area, and 
one from the Warrensburg area have been added to their network in 2006 and 
continue to provide servicesto BA+memberss in 2007. Some specialists remain 
dissatisfied with the MO HealthNet Managed Care reimbursement rates. Blue- 
Advantage Plus does utilize specialists from their commercial network and 
reimburses them at twenty percent overthe Medicaid fee schedule. Customer 
Service staff continued active recruitment efforts for specialty medical providers. 
Urgent care centers associated with OSCO Drugsand Walgreen's are now 


available to BA+memberss as well. 


The health plan reported that their relationship with providers continued to 
improve during 2007. Blue-Advantage Plus continues to operate their providers’ 
advisory committee that they utilize for review of intemal policies and activities. 
Physician complaints and member satisfaction surveys were used to trigger 
corrective actionsand educational opportunities with providers. Provider 
Relations representatives contact any office that isfound to be out of 
compliance with the after-hours access requirements. All member complaints 
regarding lack of after-hours accessare forwarded to provider relations. The 
appropnate representative contacts the provider office and provides 
educational information to staff. The Blue-Advantage Plus requirements are 
reviewed and coaching is provided about what type of directions for members 
must be in place. Follow-up continues until all comective action isin place. The 


five representatives visit their assigned providers quarteny. 


Blue-Ad vantage Plus also reported initiating corective action with their 
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transportation subcontractor, MIM. A corective action plan wasdeveloped to 
reduce callabandonment and to improve call response time. These efforts 
resulted in improvement in services. The health plan has quarterly meetings with 
MT to review call information and to provide follow-up on complaints or 
problems experienced. 






a, Performance Management Solutions Group 333 
— A division of Behavioral Health Concepts, Inc. 


*Deme a banee mam commn m BWC 


MO HealthNet Managed Care Extemal Quality Review Section 6 
Report of Findings - 2007 Blue-Advantage Plus of Kansas City 
Member Services staff disc uss issues with members, such as providers terminated 
from the BA+Panel. The memberis advised of these changes by letter, but they 
often call Member Services forclarification. Member Services staff assist in 
identifying a new providerorPCP. They often discussaccessto after-hours 
services. They refermembersto urgent care centers and the Nurse Line. Follow- 
up occurs with the providerand a referral is made to the Provider Relations 


section. 


Case Managersare involved with ensure that members have accessto quality 
and timely health care ona daily basis. They assist membersin locating 
specialists, in obtain normal health care services, as well as extraordinary services 
when they are required. Through the Care Coordination programsand the 
Healthy Companion Program, members with specific diseases obtain regular 


and adequate health care. 


Ratings regarding Access Standards regulations (100%) reflect that Blue- 
Advantage Plus submitted all required policy and proceduresto the SMA for 
their approval for the third consecutive year. During the on-site review all 
practices observed indicated that the health plan made a concerted effort to 
ensure that they were compliant with the MO HealthNet Managed Care 


contract requirements and all federal regulations. 
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Table 50 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (BA+) 





Federal Regulation mae 

438.206(b)(1)(i-v) Availability of Services: Provider Network 2 2 2 
438.206 (b) (2) Access to Well Woman Care: Direct Access é 2 2 
438.206(b)(3) Second Opinions 2 2 2 
438.206(b)(4) Out of Network Services: Adequate and Timely 2 > 2 
Coverage 

438.206(b)(5) Out of Network Services: Cost Sharing 2 2 2 
438.206(c)(1)(i-vi) Timely Access 2 2 2 
438.206(c)(2) Provider Services: Cultural Competency 2 2 2 
438.208(b) Care Coordination: Primary Care 2 2 2 
438.208(c)(1) Care Coordination: Identification 2 2 ? 
438.208(c)(2) Care Coordination: Assessment 2 2 2 
438.208(c)(3) Care Coordination: Treatment Plans 2 2 2 
438.208(c)(4) Care Coordination: Direct Access to Specialists 2 2 2 
438.210(b) Authorization of Services 2 2 2 
438.210(c) Notice of Adverse Action 2 2 2 
438.210(d) Timeframes for Decisions, Expedited Authorizations 2 2 2 
438.210(e) Compensation of Utilization Management Activities 2 2 2 
438.114 Emergency and Post-Stabilization Services 2 2 2 
Number Met 17 17 17 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 


Rate Met 100.0% 100.0% 100.0% 
Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Structures and Operation Standards 

Blue-Ad vantage Plus provided regular oversight to all subcontractors. The health 
plan meets with New Directions Behavioral Health, and MTM at regular 
Delegated Oversight Quality Meetings. They continue to meet with Doral Dental 


ona monthly basisto monitora correction action plan that isin place. 


Blue-Advantage Plus implemented CareGuide QI software. Thistool allowed for 


more efficient documentation of the Milliman Criteria and hasallowed nursing 
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staff to make more informed medical management decisions. Using this tool in 
collaboration with provider discussions allowed forthe most appropnate 
authonzation of inpatient services. The Milliman Criteria provided a guide for 
medical practice. However, the health plan also used specific practice 
guidelines from the American College of Obstetriciansand Gynecologists 
(ACOG) and the Academy of Pediatrics. Practice guidelines are distributed by 
the Provider Relations Representatives. This group also assesses if the practice 
guidelinesare in place and utilized. All providers were encouraged to recognize 
best practices and follow nationally accepted guidelines. 


The credentialing policies and procedures were reviewed and found to be 
compliant with SMA contract requirements and federal regulations. The policies 
and procedures follow NCQA and URAC standards. A list of all providers and 
their credentialing dates is maintained by the health plan to assure that re- 


credentialing iscompleted asrequired. 


The Blue-Advantage Plus Customer Service operation has continued to improve. 
Customer representatives offer members options for care, especially after hours. 
A scripting matrix wasadded so representativescan look up procedures 
pertaining to the member sinquiry, and provide adequate information. The 
system incorporates prompts for staff to ensure that language and level of 
explanation meet member needs. Talking points are highlighted in all links. Cross 
training of this system occurs with Memberand Customer Services staff so they 


Can provide backup. 


Member Services and Case Managersare not directly involved in these issues. 
They are aware of the stepsto take if a member requests disenrollment or if there 


isa question about approving ordenying benefits. 


Ratings for compliance with Structure and Operation Standards regulations 


(100%) reflect that Blue-Advantage plus has completed all policy and 
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procedural requirements of the SMA forthe third consecutive year. All practice 
observed during the on-site review supported that the health plan hasmade 
every effort to be compliant with both the MO HealthNet Managed Care 


contract requirements and federal regulations. 
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Table 51 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (BA+) 










Federal Regulation 


2005 2006 


438.214(a,b) Provider Selection: 2 






Credentialing/Recredentialing 2 2 
438.214(c) and 438.12 Provider Selection: 2 2 2 
Nondiscrimination 
438.214(d) Provider Selection: Excluded Providers 2 2 2 
438.214(e) Provider Selection: State Requirements 2 2 2 
438.226 and 438.56(b)(1-3) Disenrollment: 2 

; Geaas 2 2 
Requirements and limitations 
438.56(c) Disenrollment Requested by the Enrollee 2 2 2 
438.56(d) Disenrollment: Procedures 2 2 2 
438.56(e) Disenrollment: Timeframes 2 2 2 
438.228 Grievance System 2 2 2 
438.230(a,b) Subcontractual Relationships and 2 2 > 
Delegation 
Number Met 10 10 10 
Number Partially Met 0 0 10 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 














Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Measurement and Improvement 

Blue-Advantage Plus took extra effort to deal with the issue of Fraud and Abuse 
in 2006 and these efforts continued in 2007. They moved their Special 
Investigation Unit into Audit Services to assist in facilitating the process of 
identifying and rectifying fraud and abuse. When fraud and abuse is suspected, 
the health plan doesnot renew provider contracts at their next renewal date. 
Other actions involve education of providers regarding identified problem areas. 
The professional investigation unit was originally established in 2004, wasactive 


throughout 2007, and continuesto assist when a suspected problem arises. 


The health plan reports that their network includes more than 1600 physicians. 


They are experiencing fewercomplaints each year. Blue-Advantage Plus staff 
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believe this is due to the longevity of the relationships with most of these 
providers. The health plan employsa Physicians Advisory Committee and 
provides information and training prorto making policy and procedural 
changes. This group assists in communicating necessary changes within the 
providercommunity. Physician profiling occurs and incentivesare in place 
through the health plan’s Quality Program. Quarteny audits are completed and 


communicated to all providers. 


Blue-Ad vantage Plus was involved in the community-based Kansas City Quality 
Improvement Consortium. The group developed clinical practice guidelines for 
diabetesand asthma. The group hasalso completed obesity guidelines. The 
health plan continuesto encourage all providers to use practice guidelines 
accepted by national organizations, as well as those based on local standards. 
The health plan used the Providers Office Guide and health plan newsletters to 


disseminate information about practice guidelines to the provider community. 


Blue-Ad vantage Plus submitted all required information to complete the 
Validation of Performance Measures, as requested. They continue to operate a 
health information system within the guidelines of that protocol. All encounter 
data requested wasprovided in the corect format. The details regarding these 


areas of validation can be reviewed within specific sections of this report. 


If practice guidelines or other written information is requested by a memberit is 
referred to Tylisa Wyatt, Compliance Analyst. She then sends out required 
information. Staff wasnot aware of membersspecifically asking for specific 


practice guidelines in the past year. 


Ratings forthe Measurement and Improvement sections were found to be 
(100%) forthe third consecutive year, which reflects that all required policy and 
practice meets the requirements of the MO HealthNet Managed Care contract 
and the federal regulations. 
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Table 52 - Subpart D: Quality Assessment and Performance Improvement Measurement and 
Comparison (BA-+) 


















Federal Regulation 


2005 2006 


438.236(b)(1-4) Practice Guidelines: Adoption 2 2 2 
438.236(c) Practice Guidelines: Dissemination 2 2 2 
438.236(d) Practice Guidelines: Application 2 2 2 
438.240(a)(1) QAPI: General Rules 2 2 2 
438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCO 2 2 2 
Quality Improvement and PIPs 

438.240(b)(2)(c) and 438.204(c) QAPI: Performance 2 > > 
Measurement 

438.240(b)(3) QAPI: Basic Elements/Over and Under 2 2 2 
Utilization 

438.240(b)(4) QAPI: Basic Elements regarding Special 2 > > 
Healthcare Needs 

438.240(e) QAPI: Program Review by State NA NA NA 
438.242(a) Health Information Systems 2 

438.242(b)(1,2) Health Information Systems: Basic Elements 2 2 2 
438.242(b)(3) Health Information Systems: Basic Elements 2 2 2 
Number Met 11 11 11 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: Regulation 438.240(e) refers to program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
processand isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable to the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Grievance Systems 

The Grievance and Appealssystem wasmoved underthe umbrella of Blue- 
Advantage Plus to facilitate improved response time to memberand provider 
complaints, gievancesand appeals. The health plan reports that this change 


hashad postive resultsto date. 


The health plan utilizesa Medical Member Appeal Panel, which is staffed by the 
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Medical Director, two policy holders, and a Blue-Advantage Plus representative, 
who servesasa neutral team member. Decisions are made by the panel. If an 
appeal isnot overtumed by the panel, the appeal issent out forreview by an 


independent review organization. 


Grievancesinvolving subcontractors are sent to the Quality of Care Committee. 
When the issue involvesa provider, the health plan’s provider relations sta ff 


investigate and then assist in addressing the problem. 


Both Case Managersand Member Services staff are aware of all the 
requirements of the Grievance and Appeals system. They assist members in 


making referrals and negotiating the system, as necessary. 


Rating forcompliance with Gnevance System regulations (100%) remained 
complete asoccunred for four consecutive program years. The health plan 
takes pride in theirGrevance and Appeal policy and procedures. All practice 


witnessed at the time of the on-site review, wasin compliance. 
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Table 53 - Subpart F: Grievance Systems Yearly Comparison (BA+) 


BA+ 
Federal Regulation 
2005 2006 2007 

438.402(a) Grievance and Appeals: General Requirements 2 2 2 
438.402(b)(1) Grievance System: Filing Requirements - 2 2 2 
Authority 
438.402(b)(2) Grievance System: Filing Requirements - 2 > > 
Timing 
438.402(b)(3) Grievance System: Filing Requirements - 2 2 2 
Procedures 
438.404(a) Grievance System: Notice of Action - Language 2 > > 
and Format 
438.404(b) Notice of Action: Content 2 2 2 
438.404(c) Notice of Action: Timing 2 2 2 
438.406(a) Handling of Grievances and Appeals: General 2 2 > 
Requirements 
438.406(b) Handling of Grievance and Appeals: Special 2 
Requirements for Appeals 
438.408(a) Resolution and Notification: Basic Rule 2 2 
438.408(b,c) Resolution and Notification: Grievances and 

i . 2 2 
Appeals - Timeframes and Extensions 
438.408(d)(e) Resolution and Notification: Grievance and 2 2 > 
Appeals - Format and Content of Notice 
438.408(f) Resolution and Notification: Grievances and 2 2 2 
Appeals - Requirements for State Fair Hearings 
438.410 Expedited Resolution of Appeals 2 2 2 
438.414 Information about the Grievance System to > > 
Providers and Subcontractors 
438.416 Recordkeeping and Reporting Requirements 2 2 2 
438.420 Continuation of Benefits while Appeal/Fair Hearing 2 

2 2 

Pends 
438.424 Effectuation of Reversed Appeal Resolutions 2 2 2 
Number Met 18 18 18 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

Blue-Ad vantage Plus hasexcelled in meeting all policy, procedure, and practice 
areasof compliance with both the MO HealthNet Managed Care contract 
requirements, and the federal regulations for the third consecutive year. The 
health plan strengthened their programs, and engaged in a number of initiatives 
that served to improve the quality, accessand timeliness of service to their 
members. Blue-Advantage Plus pointed to their member loyalty as proof of their 
focuson meeting member needs. The health plan continuesto operate, 
expand, and create initiatives, several in conjunction with the Behavioral Health 
Organization, that go beyond the strict requirements of their contract. These 
initiatives focus on prevention in an effort to avoid more intrusive treatment for 
members. Blue-Advantage Plus dedicates resources enabling staff to be 
responsive and supportive to members by ensuring that their healthcare needs 


are metin an effective and efficient manner. 


QUALITY OF CARE 

The quality of healthcare services produced through Blue-Advantage Plus 
remains high asa result of their commitment to continuing quality improvement. 
The health plan utilizes advisory groups from the community and physicians to 
ensure that they have a sound perspective on methods that work and where 
improvements are necessary. The health plan subcontracts with New Directions 
Behavioral Health. Quality servicesare produced and are reflected in their 

exc eptional initiatives, such ascoordination of case management activities, the 


PACT, and Personal Transition Services (PTS) programs. 


ACCESS TO CARE 
Blue-Advantage Plus exhibits their commitment to accessto care through their 
enhanced service initiatives. They have developed new initiatives that improve 


member servicesand utilize health plan resources, such as Care Advance, a 
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project that uses health plan data to inform them about memberissues. They 
participate in community activities to ensure that members have the best 


information on primary care providersand specialists. 
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TIMELINESS OF C ARE 

Blue-Advantage Plus demonstrates their commitment to ensure the timeliness of 
healthcare by the improvement projects they undertake and new initiatives 
started each year. Examplesof these programsinclude the BA+Complaint 
Process, “Race for Resolution,” which isa well constructed and important 
initiative that improved the health plan’s responsiveness and timelines to both 
member grievancesand appeals, and provider complaints, grievances, and 


appeals. 


RECOMMENDATIONS 

1. Continue development of projects utilizing available resourcesand data 
to justify and assist in understanding member service needs. 

2. Continue development and use of products, such asCareAdvance, in 
predictive modeling and supporting empowement of members to seek 
appropnate health interventions. 

3. Continue effortsto improve behavioral health services, such as monitoring 
inpatient facilities, completing proactive discharge planning, and 


aftercare services. 
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Childrens 


FAMILY HEALTH PARTNERS 








7.1 Performance Improvement Projects 


METHODS 

DOCUMENT REVIEW 

Children’s Mercy Family Health Partners supplied the following documentation 
for review: 


e Improving Well Child Visits in the First 15 Months of Life 
e Improving Non-Emergency Transportation Services 


The health plan supplied data at the time of the on-site review including 
narrative information and data analysis. Some additional information was 


supplied after the on-site review asa final submission of statistical analysis. 


INTERVIEWS 

Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on J uly 22, 2008, during the on-site 
review at the Kansas City, Missouri offices, and included the following: 


Ma’ata Touslee - Director, Health Services 

J enny Hainey - Manager, Quality Management 

KaMara Sams - Project Manager, Health Improvement 

Greg Hanley - Manager, Health Improvement/ Disease Management 


Interviewees shared information on the validation methods, study design, and 
findings. Technical assistance regarding study design and presentation of 
findings was provided by the EQRO. The following questions were addressed: 


Wasthe population forthe study expanded? 
How were the accuracy, consistency, and validity assured? 
e What findings were relevant to the MO HealthNet managed care 
population? 
e How wasimprovement analyzed? 
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e Whatare the conclusions about the effectiveness of the interventions 
analyzed? 
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FINDINGS 

The first PIP evaluated was “Improving Well-Child Visits in the First 15 Months of 
Life.” The study topic was well developed based on the health plan’s HEDIS rates 
ascompared to the HEDIS Medicaid mean and the Missouri Medicaid mean. 

The health plan identified a decrease in their rate for the period from 2000 to 
2005 and chose thistopic to improve this measure asan important preventive 
effort in child health. The study focused on conecting deficienciesin care of any 
member who should be receiving the well-child visits). No members were 
excluded who fell within the spectrum of the query date identified. The topic 
choice and rationale were well supported by a review of local issues and 
comparisons to State and national trends. A thorough literature review was 


conducted and the outcomes included in the documentation submitted. 


The hypothess, and basis of the study, is that parents who receive information 
and reminders are more likely to: 

e Schedule a well child visit 

e Receive annual EPSDT exams 


e Receive recommended immunizations per schedule 


These families are less likely to: 
e Have sick child visits 


e Missrecommended immunizations 


The premise of the study and the cornesponding study question are simple and 
focused. 

The study question is: “Do reminder lettersto the parents of children ages0-15 
months, who need well-child exams result in increased rate of children with sx of 
more visits by their 15 month birth date?” The approach utilized allowed the 
health plan to analyze if this single intervention is effective, prorto addressing 


broadercausesorbamiersto members receiving these services. It is possible for 


C= Performance Management Solutions Group 352 
oe A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 


this study to evolve and become more complex in time. 


The study indicator was the rate of well-child visits in the first 15 months of life for 
children in the study group. The study group included children identified ina 
query based ona specific date forthe ages of the children involved, and who 
had received Oto six well child visits. The indicator measured would indicate a 
change in health status and is focused on the issue of improving preventive care. 
The issues that can be tracked are delineated in the hypotheses. The query 
group wasdefined aschildren within a specific birth range. These members 
were tracked throughout the intervention. It isnoted that HEDIS specifications 
were followed throughout the study. Additionally, the health plan analyzed 
factors that could influence improvement from the baseline through the second 
study period to ensure that all factorsare reflected in the analysis of a positive 


change. 


The study planned to query claims data to create baseline statistics. Additional 
quenes occured at quarteny intervals to obtain data the effectiveness of the 
intervention. The narrative clearly defined the sourcesof data and a systematic 
approach to obtaining data that provided confidence that it would be valid 
and reliable. A prospective data analysis plan wasdocumented. It was based 
on the measurement of increased well-child visits post intervention. The date to 
be collected was presented cleany and understandably through the entire 

disc ussion of the study design and the prospective data analysisplan. It isnoted 
that the study design was developed with the health plan’s Health Improvement 
Committee. The development of the study design included input from 
practitionersand physicians. Thisapproach to study design provides evidence 
of the health plan’s commitment to sincere improvement of their processes to 


enhance service delivery to its members. 


Proposed interventions, bamier analysis, data analysis and the quality 


Gea Performance Management Solutions Group 353 
Se A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 
improvement processes were described and explained in a mannerthat 
enhanced project analysis. Reasonable interventions were developed. These 
included direct member contact through letters including the well child 
schedule. The approach provided education to each family regarding the 


importance of scheduling the required well-child examinations. 


The documentation received included the preliminary analysis of the project. 
This wasan in-depth analysis on the information available to date. The 
information provided did indicate an overall improvement in members obtaining 
well-child visits. The graphs and charts provided were clearand understandable. 
They did corelate to the narative explanation. The information provided 
compared the baseline and re-measurement data. The analysis provided did 
explain the data and the results. The enhanced information submitted afterthe 
on-site review indicatesa complete set of testing for statistical significance. 
These tests determined that there wasa positive impact asthe result of 
implemented interventions. The average numberof well-child visits increased by 
2.5, which wasa significant increase. The change, identified by the increase in 


well-child visits, was significant at the 95% confidence level. 


The documentation did include a plan forimprovement after the completion of 
the initial intervention. The initial evaluation determined that the intervention did 
have positive impact on member behavior. The plan for improvement indicates 
that new interventions are planned to create additional positive results for 
members receiving well-child visits in the first 15 months of life. The study 
continued to be developed during the past cycle and the information obtained 
hasallowed the health plan to assess the effectiveness of the intervention 
strategies and to obtain significant and sustained improvement. Asthe result of 
the PIP, the health plan will continue to send reminder letters to all members in 


the first 15 months of life on an annual basis. 
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The second PIP evaluated was “Improving non-emergent transportation services 
to members.” Thiswas submitted asa non-clinical Performance Improvement 
Project. The study topic wasdeveloped with the choice justified in the narative. 
This is a diffic ult issue to address and the information presented indicatesa 
thorough investigation of the need for improvement. This information was not 
based on any extemal information or literature review. The study is based on 
sound reasoning and a cleanly identified local need. This project is presented as 
a serious attempt to solve a performance problem. It isalso based ona desire to 


improve the ability of members to access health services. 


The project wascleany focused on corecting deficiencies in the members’ 
ability to accessservices. It wasbased on the hypotheses that developing an 
operational action plan and conducting frequent oversight visits with the 
transportation vendor. 

e Will increase utilization of transportation services per thousand; 

e Willdecrease transportation related grievances per thousand; and 


e Willincrease the percentage of unique membersserved perthousand. 
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The project wasopen to any member requesting transportation services. The 
study question is: “Will developing an operational action plan and conducting 
more frequent oversight visits with transportation vendors: 
a. Increase utilization of transportation service per thousand members by 
20%; 
b. Decrease transportation related gnevances per thousand members by 
20%; and 
c. Increase the percentage of unique members served per thousand 


members by 20%?” 


The question isclear and delivered in an informative manner that indicatesa 
plan forthe entire project. The topic and expected achievements are clearly 
identifiable. The key indicators presented are the ratio of utilization of 
transportation services, the rate of member grievances, and the percentage of 
unique membersserved. These indicators are straightforward, simple, and 
understandable. The indicators are applicable to the study topic. These 
indicators measure the functional status of a service provided to membersand 
provide the health plan with a measure to indicate the success of proposed 
interventions. The study population includes any health plan member requesting 


transportation services. 


The information provided a baseline determined by a sound study design for 
data collection. Documentation included a prospective data analysis and 
collection plan forthe study that isappropnately detailed. The narative 
included information on the use of the statistician available to the health plan. 
Data analysis will be performed quarteny and will include control charting and a 
comparative analysis of pre and post-intervention effectiveness, aswellasan 
assessment of study variables. Data sources were defined and specific. Analysis 
doesinclude a summary provided to the Community Advisory Council for 


member advocate and member input. 
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The planned intervention was the implementation of an operational action plan 
and frequent oversight meetings with the transportation vendor. The intervention 


was described in detail and included post-intervention planning. 


Data analyss was completed forthe baseline year 2006 and for 2007. The 
information was preliminary and included a change in vendors. The original 
vendor was not showing improvement and wasreplaced. The change in 
vendorstriggered more intense interventions, such asincreased oversight 
meetings. The health plan tracked unique and unduplicated member numbers 
and grievance numbers. At the end of 2007 there wasa decrease in 
transportation grievances. The health plan believesin the change in vendors, 
improved network, and increased oversight resulted in this postive impact, but 
the improvement was not large enough to be statistically significant. The health 
plan will continue with these efforts in the future in the hope to have a significant 


impact. 


The health plan looked ata real and difficult issue and created a concrete 
action plan to impact the problems with non-emergent transportation services. 
The project utilized community advisory and intemal committees to define the 
problem and evaluate success. The project hasthe continued potential to have 


significant positive impact on memberservices and organization functioning. 


CONCLUSIONS 


QUALITY OF CARE 

Quality services are provided in the most appropriate environment, and ina 
preventive manner, whenever possible. These two projects embodied these 
values and sought to enhance the services available to the MO HealthNet 


managed care members. Quality healthcare is evident in the types of 
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interventions used in these projects. The strong reliance on case management 
and a personal approach to educating and assisting membersis evidence of 


the commitment to quality services to members. 


ACCESS TO CARE 

The focus of both of the Performance Improvement Projects developed by the 
health plan indicated a strong commitment to improving accessto the best 
healthcare in the most appropriate medical setting. In the first PIP the health 
plan provided education about the importance of accessing preventive 
healthcare services. In the second project reviewed the health plan attempted 
to provide enhanced servicesto members enabling them to obtain non- 
emergent transportation services efficiently. Both projects enhanced members’ 


ability to access health care services. 


TIMELINESS OF C ARE 

The PIP regarding Well-Child Visits in the First 15 Months of Life concentrated on 
timely preventive care forchildren in thisage range. The educational approach 
taken by this PIP empowers families to make sound decisions that can lead to 
continued efforts to obtain timely preventive healthcare serviceson an ongoing 
basis. The PIP that focused on improving non-emergency transportation services 
directly impacted members’ ability to access timely health care. The project 
sought to ensure that members had requested and appropnate transportation 
services available when they needed it to ensure that health care appointments 


were kept and needed health care services were received. 


RECOMMENDATIONS 
1. Continue the work the health plan is doing with the statistician to perfect 


PIP methodology and data analysis. 
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2. Incorporate a literature review orresearch on topicsto support the 


decision to embark upon a study topic. 


3. Include the names, titles, and responsibilities of all health plan staff 


involved in the PIP in the narrative supplied to the EQRO for review. 
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7.2 Validation of Performance Measures 


METHODS 

This section describes the documents, data, and persons interviewed forthe 
Validation of Performance Measures for Children’s Mercy Family Health Partners. 
Children’s Mercy Family Health Partners submitted the requested documents on 
January 28, 2008. The EQRO reviewed documentation between J anuary 28, 
2008 and J uly 1, 2008. On-site review time was used to conduct follow-up 
questionsand provide feedback and recommendations regarding the 


performance measure rate calculation. 


DOCUMENT REVIEW 
The following are the documents reviewed by the EQRO: 
e The Baseline Assessment Tool (BAT) submitted by Children’s Mercy Family 
Health Partners forthe HEDIS 2007 data reporting year 
e Qualis Health’s NCQA HEDIS Compliance Audit Report for HEDIS 2007 
e Children’s Mercy Family Health Partners’ information systems (IS) Policies 
and Procedures pertaining to HEDIS 2007 rate calculation 
e Children’s Mercy Family Health Partners’ information services (IS) policies 
on disaster recovery 
e Children’s Mercy Family Health Partners’ HEDIS committee agendas for 
2007 
e Children’s Mercy Family Health Partners’ HEDIS 2007 Training Manual for 
the medical record review process 
e Documentation, data filesand source code of the in-house application 
for immunization rate calculation 


e System edits for the claimsmanagement system 
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The following are the data files submitted by Children’s Mercy Family Health 
Partners forreview by the EQRO: 

e ADV_DenomNumData.txt 

e ADV_EnrollmentData txt 

e AWC_DenomNumData.txt 

e AWC_EnrollmentData txt 

e FUH_DenomNumData.txt 

e FUH _EnrollmentData.txt 


INTERVIEWS 

The EQRO conducted on-ste interviews with J anet Benson, ITAnalyst; Johanna 
Groves, Senior Quality Management Nurse; Bob Clark, Director, IT/IS; and J enny 
Hainey, QM Managerat the Children’s Mercy Family Health Partners in Kansas 
City, MO on Tuesday, J uly 22, 2008. This group wasresponsible forcalculating the 
HEDIS performance measures. The objective of the vist was to verify the data, 
methodsand processes behind the calculation of the three HEDIS 2007 


performance measures. 


FINDINGS 

Children’s Mercy Family Health Partners used the Administrative Method for 
calculation of the Follow-Up After Hospitalization for Mental Illness and Annual 
Dental Visit measures. The Hybrid Method wasused forthe calculation of the 
Adolescent Well-Care Visit measure. MO HealthNet Managed Care health plan 
to MO HealthNet Managed Care health plan comparisons of the rates of Follow- 
Up After Hospitalization, Well-Care Visits, and Annual Dental Visit measures were 
conducted using two-tailed z-tests. For companions that were statistic ally 
significant at the 95% confidence interval (Cl), the zscore (z), the upperand 


lowerconfidence intervals (Cl), and the significance levels (p <.05) were 
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reported. 


The rate for the HEDIS 2007 Adolescent Well-Care Visit reported to the SMA and 
the State Public Health Agency (SPHA) by Children’s Mercy Family Health 
Partners was 42.82%. This was significantly higher than the statewide rate forMO 
HealthNet Managed Care health plans (34.81% z =-0.33, 95% CI: 28.89%, 40.74%; 
p >.95). ). Thisreported rate isa significant increase overthe rate (32.93%) 
reported by this health plan in the 2004 EQR report. 


The reported rate for Children’s Mercy Family Health Partners for the 2007 HEDIS 
Follow-Up After Hospitalization for Mental Illness was 48.50% for follow-up after 7 
days. The rate reported for 7-day follow-up wascomparable to the statewide 
rate for MO HealthNet Managed Care health plans (35.52%; z =-0.34, 95% Cl: 
22.96%, 48.08%; n.s.); this rate is significantly higher than the 7 -day rate (45.15%) 
reported by the health plan in the 2006 EQR report. The rate reported for 30-day 
follow-up (88.37%) was significantly higher than the statewide reported rate for 
MO HealthNet Managed Care health plans (60.06%; z = 1.38, 95% Cl: 47.50%, 
72.62%; p >.95). This rate is also significantly higherthan the 30-day rate (71.52%) 
reported by the health plan in the 2006 EQR report. 


The HEDIS 2007 combined rate for Annual Dental Visits reported by Children’s 
Mercy Family Health Partners was 37.49%, which is significantly higher than the 
statewide rate forMO HealthNet Managed Care health plans (32.50%, z = 0.04; 
95% C1: 29.30%, 35.69%; p >.95). Thisreported rate islowerthan the rate (39.09%) 
reported by the health plan in the 2005 EQR report. 


The following sections summane the findings of the processfor validating each 
of the performance measures in accordance with the Validating Performance 
Measures Protocol. The findings from all review activities are presented 


according to the EQRO validation activity, with the findings foreach measure 


C= Performance Management Solutions Group 362 
‘—Sagiseee A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 
discussed within the activitiesasappropnate. Please referto the tablesin the 
main report for activities, ratings, and comments related to the CMS Protocol 


Attachments. 


DATA INTEGRATION AND CONTROL 

The information systems management policiesand procedures for rate 
calculation were evaluated consistent with the Validating Performance 
Measures Protocol. Thisincluded both manual and automatic processes of 
information collection, storing, analyzing and reporting. The EQRO was provided 
with a demonstration of MedMeasures software system which was newly 
implemented by Children’s Mercy Family Health Partners for HEDIS 2007. The 
accompanying MedCapture system wasalso demonstrated; this system allows 


forthe calculation of the Hybrid hits from the input medical record data. 


Forallthree measures, Children’s Mercy Family Health Partners was found to 

meet all criteria for producing complete and accurate data (see Attachment V: 
Data Integration and Control Findings). There were no biases or enors found in 
the manner in which they transferred data into the repository used for 
calculating the HEDIS 2007 measures. Children’s Mercy Family Health Partners 
used an extemal vendorapplication module forrate calculation. The EQRO was 
provided with a demonstration of the data flow and integration mechanisms for 


extemal databases for these measures. 


DOCUMENTATION OF DATA AND PROCESSES 

Data and processes used forthe calculation of measures were adequate (See 
Attachment Vil: Data and Processes Used to Calculate and Report Performance 
Measures). Children’s Mercy Family Health Partners met all criteria applicable for 
all three measures. Children’s Mercy Family Health Partners does utilize statistical 
testing and comparison of rates from yearto year. 
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PROCESSES USED TO PRODUCE DENOMINATORS 

Children’s Mercy Family Health Partners met all criteria for the processes 
employed to produce the denominators of all three performance measures (see 
Attachment X: Denominator Validation Findings). This involved the selection of 
eligible members forthe servicesbeing measured. Forthe Follow-Up After 
Hospitalization measure, a total of 301 eligible members were reported and 
validated by the EQRO. Forthe denominator of the Adolescent Well-Care Visits 
measure a sample of 411 eligible members were reported and validated. The 
Annual Dental Visit denominator included 23,806 reported and EQRO-validated 
eligible members. Age ranges, datesof enrollment, medical events, and 
continuous enrollment were programmed to include only those members who 
met HEDIS 2007 criteria. 


PROCESSES USED TO PRODUCE NUMERATORS 

All three measuresincluded the appropnate data ranges for the qualifying 
events (e.g., well-care visits, follow-up visits and dental visits) asspecified by the 
HEDIS 2007 criteria (see Attachment XIll: Numerator Validation Findings). 


Children’s Mercy Family Health Partners used the Hybrid Method to calculate 
HEDIS 2007 Adolescent Well-Care Visits measure. All 30 of the medical records 
requested were received; 29 records resulted in validated hybrid hits; the one 
record received that could not be validated showed no proof of Anticipatory 
Guidance. Asa result, the medical record review validated 42 of the 43 hybrid 
hits reported. The health plan reported 133 administrative hits; of these, the 
EQRO wasable to validate all 133. Based on the numberof hits validated by the 
EQRO, the rate calculated was 42.47%, compared to the reported rate of 
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42.82%. The total estimated bias forthe Adolescent Well-Care Visits measure was 


a 0.35% overestimate of the rate. 


For the HEDIS 2007 Follow-Up After Hospitalization measure, the EQRO’s review of 
the administrative hits validated 144 of the 146 reported by the health plan for 
the 7-day follow-up. The rate reported by the health plan was 48.50% and the 
rate calculated by the EQRO was 47.84%, with a bias of 0.66%, an overestimate 
by the health plan in the reporting of the measure. The EQRO validated 265 of 
the 266 administrative hits reported by the health plan forthe 30-day follow-up 
measure. The rate reported by the health plan was 88.37% and the rate 
calculated by the EQRO was 88.04%; an overestimate bias of 0.33% by the 


health plan in the reporting of the measure. 


Review of the administrative hits for the combined rate of the Annual Dental Visit 
measure validated 8,913 of the 8,926 hits found by the health plan. The rate 
reported by the health plan was 37.49%; the rate validated by the EQRO was 
37.44%. The total estimated bias forthe Annual Dental Visit measure wasa 0.05% 


overestimate of the rate. 
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SAMPLING PROCEDURES FOR HYBRID METHODS 

The Hybrid Method wasused forthe Adolescent Well-Care Visits measure. CMS 
Protocol Attachment XIl; Impact of Medical Record Review Findings and 
Attachment XV: Sampling Validation Findings were completed for this measure. 
Children’s Mercy Family Health Partners wascompliant with all specifications for 


sampling processes. 


SUBMISSION OF MEASURES TO THE STATE 

Children’s Mercy Family Health Partners submitted the DSTfor each of the three 
measures validated to the SPHA (the Missouri Department of Health and Senior 
Services) in accordance with the Code of State Regulations (19 CSR § 10-5.010 
Monitoring Health Maintenance Organizations) and the SMA Quality 


Improvement Strategy. 


DETERMINATION OF VALIDATION FINDINGS AND CALCULATION OF BIAS 
The following tables summanie the estimated biasin reporting each of the 
measures and the final validation findings. Table 54 showsa small overestimate 


(inside the 95% confidence interval) forall rates. 


Table 54 - Estimate of Bias in Reporting of CMFHP HEDIS 2007 Measures 
Direction of 
Estimate of Bias | Estimate 
Adolescent Well-Care Visits 0.35% Overestimate 


Follow- Up After Hospitalization (7 days) 0.66% Overestimate 
Follow-Up After Hospitalization (30 days) 0.33% Overestimate 
Annual Dental Visit 0.05% Overestimate 





FINAL AupIT RATING 
The Final Audit Rating foreach of the performance measures was based on the 


findings from all data sources that were summanzed in the Final Performance 
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Measure Validation Worksheet. Table 55 shows the final audit findings foreach 
measure. All measures were Substantially Compliant, as there wasno significant 


bias associated with the overestimated rates. 


Table 55 - Final Audit Rating for CMFHP Performance Measures 





Final Audit Rating 
Adolescent Well-Care Visits Sub sta ntia lly Compliant 
Follow- Up After Hospitalization (7 days) Sub sta ntia lly Compliant 
Follow-Up After Hospitalization (30 days) Substantially Compliant 
Annual Dental Visit Sub sta ntia lly Compliant 





Note: Fully Compliant =Measure was fully compliant with State specifications; Substantially 
Compliant =Measure was substantially compliant with State specifications and had only minor 
deviations that did not significantly biasthe reported rate; A significant biasin the rate was defined 
asa numbercalculated by the EQRO that fell outside the 95% confidence interval of the rate 
reported by the health plan. Not Valid =Measure deviated from State specifications such that the 
reported rate wassignificantly biased. Thisdesignation is also assigned to measures for which no 
rate was reported; Not Applicable =No MO HealthNet Managed Care Members qualified forthe 
measure. 


CONCLUSIONS 

Four rates were validated forthe health plan. One of these rates was consistent 
with; and three were significantly higherthan the average forall MO HealthNet 
Managed Care health plans. 


QUALITY OF CARE 

Children’s Mercy Family Health Partner’scalculation of the HEDIS 2007 Follow-Up 
After Hospitalization for Mental Illness measure was substantially complaint with 
specifications. This measure iscategorized asan Effectiveness of Care measure 
and isdesigned to measure the effectiveness/quality of care delivered. The 
health plans 7-day follow-up rate wasconsistent with the overall MO HealthNet 
Managed Care health planscalculated rate, and 30- day follow up rate for this 
measure was significantly higher than the average forall MO HealthNet 
Managed Care health plans. Both of these rates were also significantly higher 
than the same measure rates reported in last yearsEQR report. The plan’s focus 


on this measure is evident in the results they have achieved in these rates. 
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Therefore, Children’s Mercy Family Health Partners membersare receiving a 
quality of care forthis measure at orabove the level than the care delivered to 
the average MO Health Net Managed Care member. Additionally, both of 
these rates were reported ashigherthan the National Medicaid Rate, and the 
30-day rate washigher than the National Commercial Rate. Therefore, CMFHP is 
delivering a higher level of quality than that received by the average Medicaid 
member across the nation, and a higher level of quality for the 30-day timeframe 


than isreceived by the average Commercial member across the nation. 
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The EQRO wasable to validate this rate within the reported 95% confidence 


interval and thereby has substantial confidence in the calculated rate. 


ACCESST0 CARE 

The calculated rate by Children’s Mercy Family Health Partners for the HEDIS 2007 
Annual Dental Visit rate was substantially complaint with specific ations; this 
measure iscategorized asan Effectiveness of Care measure. Because only one 
visit is required fora positive “hit”, this measure effectively demonstrates the level 
of accessto care that membersare receiving. Although the health plan’s 
reported rate for this measure was significantly higher than the average for all 
MO HealthNet Managed Care health plans, the rate is slightly lowerthan the 
rate reported by the health plan in 2005. However, CMFHP members are 
receiving a quality of care that ishigher than the level of care delivered to the 


average MO HealthNet Managed Care member. 


The EQRO wasable to validate this rate within the reported 95% confidence 


interval and thereby has substantial confidence in the calculated rate. 


TIMELINESS OF C ARE 

The health plan’s calculation of the HEDIS 2007 Adolescent Well-Care Visits 
measure was substantially compliant. This measure iscategorzed asa Use of 
Services measure and isdesgned to measure access to and timeliness of the 
care defined. The health plan’s reported rate for this measure was signific antly 
higher than the average forall MO HealthNet Managed Care health plans; this 
rate wasalso slightly higher than the rate reported by the health plan in 2004. 
Therefore, Children’s Mercy Family Health Partners membersare receiving the 
timeliness of care for this measure at a higher level than the care delivered to all 
otherMO HealthNet Managed Care members. Thisrate wasalso higher than 
the National Commercial Rate, showing that Children’s Mercy Family Health 
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Partners’ membersare receiving the timeliness of care forthis measure ata 


higher level than the average Commercial member acrossthe nation. 


The EQRO wasable to validate this rate within the reported 95% confidence 


intervals and thereby has confidence in the calculated rate. 


RECOMMENDATIONS 

1. Continue to conduct and document statistical comparisonson rates from 
yearto year. 

2. Continue to utilize the Hybrid methodology for calculating rates when 
allowed by the specifications. 

3. The health plan experienced a reduction in the Annual Dental Visit rate 
between the rate reported in 2005 and the rate reported for 2007; the 
EQRO recommends that the health plan focus on this rate to reverse this 
trend. 
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7.3 Validation of Enc ounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical Fields? 


Forthe Medical claim type, there were 107,242 encounter claims paid by the 

SMA forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete, accurate 
and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete and 
accurate, and valid. 

5. The Outpatient Units of Service field was 100.00% complete accurate and 
valid. 

6. The Outpatient Procedure Code field was 99.99% complete accurate and 
valid. The remaining field (n=1) was blank (incomplete, inaccurate and 
invalid). 

7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, and 
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fourth Diagnosis Code fields were well below the SMA threshold of 100.00% 
completeness, accuracy and validity. The second, third, fourth and fifth 
Diagnosis Code field were (44.94%, 0.30%, 0.00%, and 0.00%) complete, 

accurate and valid, respectively. The remaining fields were blank 


(incomplete, inaccurate, and invalid). 


Forthe Dental claim type, there were 19,718 encounterclaims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. All fields were 00.00% 


complete, accurate and valid. 


Forthe Home Health claim type, there were zero (0) encounter claims paid by 
the SMA forthe period J uly 1, 2007 through September 30, 2007. 


For the Inpatient claim type, there were 12,898 encounter claims paid by the 
SMA forthe period J uly 1, 2007 through September 30, 2007. 

The Inpatient Claim Type field was 100.00% complete, accurate and valid. 
The Recipient ID field was 100.00% complete, accurate and valid. 

The Admission Type field was 100.00% complete, accurate and valid. 

The Admission Date field was 100.00% complete and accurate; and valid. 
The Discharge Date field was 100.00% complete and accurate and valid. 
The Bill Type field was 100.00% complete, accurate and valid. 

The Patient Status field was 100.00% complete, accurate and valid. 

The first Diagnosis Code field was 100.00% complete, accurate and valid. 
All other Diagnosis Code fields fell well below the 100% threshold for 
completeness, accuracy, and validity established by the SMA. The second, 
third, fourth, and fifth Diagnosis Code fields were 90.64%, 0.77%, 0.0%, and 


0.0% complete, accurate and valid, respectively. The remaining fields were 


pop ON DYN FF WN 


blank (incomplete, inaccurate, and invalid). 
10. The First Date of Service field was 100.00% complete, accurate and valid. 
11. The Last Date of Service field was 100.00% complete, accurate and valid. 
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12. The Revenue Code field was 100.0% complete, accurate, and valid. 


13. The Units of Service field was 100.00% complete, accurate and valid. 


Forthe Outpatient Hospital claim type, there were 76,460 encounter claims paid 

by the SMA forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Hospital Claim Type field was 100.00% complete, accurate 
and valid. 

2. The Recipient ID field was 100.00% complete, accurate and valid. 

3. The First Date of Service field was 100.00% complete and accurate, and valid. 

4. The Last Date of Service field was 100.00% complete and accurate, and 
valid. 

5. The Units of Service field was 100.00% complete, accurate and valid. 

6. The Outpatient Procedure Code field was 98.31% complete and accurate, 
and 97.85% valid. This field requires five alohanumeric characters. There 
were 1,290 blank fields and 352 invalid fields. 

7. The Outpatient Hospital Revenue Code field was 100.00% complete and 
accurate, and valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, 
fourth, and fifth Diagnosis Code fields were well below the 100%threshold for 
completeness, accuracy and validity set by the SMA. The second, third, 
fourth and fifth Diagnosis Code fields were 57.38%, 0.04%, 0.0% and 0.0% 
complete, accurate and valid, respectively. The remaining fields were blank 


(incomplete, inaccurate, and invalid). 


Forthe Pharmacy claim type, there were 27 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. All fields examined were 
100.00% complete, accurate and valid data forall fieldsexamined. It is 


important to note that the MCHP had pharmacy claims “carved-out” of their 
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contract with the SMA that began onJ uly 1, 2007. Thisexplains the extremely 


low numbers of encounter claims during the time period reviewed. 


What Types of Encounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for Family Health Partners, an error 
analysis of the invalid entries wasconducted for fields which were lower than the 
100.00% threshold specified by the SMA. The critical fields examined for the 
Dental and Pharmacy claim type fields were 100.00% complete, accurate, and 
valid (see previous findings). The Outpatient Procedure Code fields in the 


Medical and Hospital claim types contained invalid procedure codes. 


What is the Level of Volume and Consistenc y of Servic es? 

When companing the rate of encounter claim types per 1,000 members, the 
rates of Inpatient, Medical and Hospital claim types were consistent with the 
average forall MO HealthNet Managed Care health plans, while the rates for 
Dental claim types were significantly higherthan the average forall MO 
HealthNet Managed Care health plans. This suggests that the data are 
complete and that there is better utilization of dental services and high rates of 
accessto preventive and acute care among Children’s Mercy Family Health 


Partners members. 
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To What Extent do the Claims in the State Encounter Claims Database Reflect the 
Information Doc umented in the Medical Record? Whatis the Fault/ Match Rate 
between State Encounter Claims and Medical Records? 


To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each MO HealthNet Managed 
Care health plan were randomly selected from Medical claim types for the 
period of J uly 1, 2007 through September 30, 2007 for medical record review. Of 
the 216,345 encounter claim types in the SMA extract file for) uly 1, 2007 through 
September 30, 2007, 100 encounters were randomly selected. Providers were 
requested to submit medical records for review. There were 88 medical records 
(88.0%) submitted for review. Encounters for which no documentation was 
submitted were unable to be validated. The match rate for procedures was 
51.0%, with a fault rate of 49.0% The match rate for diagnoses was 47.0%, with a 
fault rate of 53.0% 


What Types of Errors Were Noted? 

An enor analysis of the errors found in the medical record for procedure and 
diagnosis codes wasconducted. Forthe diagnosis code in the medical record, 
the reasons for diagnosis codesnot matching the SMA extract file was missing 
information (n =53) with no incorrect information. The diagnosis code listed did 


not match the descriptive information in the record. 


Forthe procedure code in the medical record, the reasons for procedure codes 
in the SMA extract file not being supported by documentation in the medical 

record were missing information (n =38), incorrect (n=7), downcoding (n=2) and 
upcoding (n=4). Examples of missing information included no code, codes listed 


that were not supported, orcodes that did not match the procedure 


description. 
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What Problems are there with How Files are Compiled and Submitted by the MO 
HealthNet MC HP? 

Since Children’s Mercy Family Health Partners included intemal control numbers 
that matched those of the SMA, the EQRO conducted the planned analyses 
comparing MO HealthNet Managed Care health plan encounter data to the 
SMA encounterclaim extract file. The SMA defined “unpaid claims’ asthose 


claims that the MCHP denied for payment, unpaid claimsdo not include claims 





paid via a capitation plan. 


MO HealthNet Managed Care health plans were requested to submit data, as 
specified by the EQRO (see Appendix 6), forthe Members represented in the 


encounter claim sample selected for validation. 


Forthe Pharmacy Claim type, all encounter data submitted to the EQRO wasof 
“paid” status. There were 0 unmatched claims that were in the CMFHP 


encounter file and absent from the SMA data. 


For all Outpatient Claim Types (Medical, Dental, Home Health and Hospital), 
CMFHP submitted 203,420 “paid” encountersand 259 “denied” claims. All paid 
encounter claims matched with the SMA encounterclaim extract file. The 259 
denied claims were not present in the SMA database (as expected); there wasa 
“hit” rate of 99.99% between CMFHP’s encounter claims and the SMA encounter 
data. 


For the Inpatient Claim Type, CMFHP submitted 12.898 encounter claims of 
“paid” sttatusand 228 “denied” claims. All paid encounter claims matched with 
the SMA encounter claim extract file. The denied claims were not present in the 
SMA database. This produced a “hit” rate of 98.23% between CMFHP’s 


encounter claims and the SMA encounterdata. 
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Why are there unmatched claims between the MCHP and SMA data files? 

The unmatched encounters are due to missing ICN numbers which are required 
to match the encounterto that of the SMA. Therefore, in all claim types, the 


encounter claims were legitimately missing from the SMA extract data. 
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What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 

While the MO HealthNet Managed Care health plan did submit the data in the 
requested format (including most ICN numbers), there are a numberof ways to 
improve the data quality by improving the database system. Asthe Intemal 
Control Numberis only assigned by the State database when a claim is paid, it is 
diffic ult to match the MO HealthNet Managed Care health plan data of 
“unpaid” and “denied” claimsto the SMA data. Asthe Intemal Control Number 
is unique only to the encounter, the ICN may be represented in multiple lines of 
data. To match the MO HealthNet Managed Care health plan data to the SMA 
data to specific fields, this requires a unique line number. Therefore each service 
provided within an encounter would have a separate line of data with a unique 


line identifier. 


CONCLUSIONS 
STRENGTHS 

1. Encounterdata wassubmitted to the EQRO in the requested format 
which allowed encounter validation for all claim types. 

2. The critical field validation of all six claim types resulted in few fields under 
the SMA established threshold of 100.00% accuracy, completeness, and 
validity. 

3. The critical fields evaluated forthe Outpatient Medical, Dental and 
Pharmacy claim types were 100.00% complete, accurate, and valid. 

4. The rate of Dental claim types were significantly higherthan the average 
forMO HealthNet Managed Care health plans, suggesting high rates of 
encounter data submission and at least moderate accessto preventive 


and acute care. 


AREAS FOR IMPROVEMENT 
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1. The Outpatient Procedure Code fields in the Outpatient Hospital claim type 
contained invalid codes. 

2. The match rate between the medical record and SMA encounterclaims 
data wascomparable to the average forall MO HealthNet Managed Care 
health plans forthe procedure code. 

3. The MCO reported no Home Health encounterclaims during the review 
period. 






a, Performance Management Solutions Group 379 
a A division of Behavioral Health Concepts, Inc. 


*Deme a banee mam commn m BWC 


MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 
RECOMMENDATIONS 
1. Examine and revise asneeded intemal system edits for invalid procedure 
codesin the NSF/CMS 1500 file layout forthe Outpatient Procedure Code 
and run validity checks after the programming of new edits. 
2. Ensure that the Inpatient Admission Date, Discharge Date and Revenue 
Code fields are complete and valid forthe Inpatient claim types, and 
institute error checks to identify invalid data. 
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7.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Priorto the site visit, documentation was received and reviewed regarding the 
MO HealthNet Managed Care Health Plan’s compliance with the State 
contract. The Extemal Quality Review Organization (EQRO) reviewed contract 
documents with the staff of the MO HealthNet Division (MHD). On-site review 
time was used to conduct interviews with those who oversee the daily practices 
of the health plan. This ensures that documentation isdeveloped and practices 
occurwithin the scope of the contract and in a manner that meets or exceeds 


federal regulations. 


A detailed protocol (BHC MO HealthNet Managed Care Health Plan 
Compliance Review Scoring Form) wasutilized to ensure that all the elements of 
the federal regulations were addressed in the review process. Additionally, an 
interview tool was constructed to validate practices that occur at the health 
plan, through interviews with Member Services and Case Management staff 
members. Follow-up on questions raised from the document review and 
requests for clarification on responses received in staff interviews were presented 
during a final interview with plan administrative staff. Document reviews 
occured on-site to validate that practicesand procedures were in place to 


guide organizational performance. 


DOCUMENT REVIEW 
The following documents pertaining to Children’s Mercy Family Health Partners 


were reviewed prorto and at the on-ste visit: 


The MO HealthNet Division supplied: 
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e State of Missourn Contract Compliance Tool (including MHD responsesand 


comments) 


Performance Management Solutions Group 382 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 
The following documents were requested for on-site review: 

e Member Handbook 

e Provider Handbook 

e 2007 Marketing Materials 

e Credentialing Policy and Annual Audit Reports 

e Policy Tracking Log 

e Staff Training Records 

e Grievance and Appeal Logs 


e 2007Annual Quality Improvement Program Evaluation 


Additional documentation made available by Children’s Mercy Family Health 
Partners included: 

e 2007 Marketing Plan 

e Children’s Mercy Family Health Partners’ Organizational Chart 

e 2007 Welcome Callssummary by Quarter 

e Connection - Member Newsletter 

e New Directions Behavioral Health - Referral to the Prevention Team Policy 

& Care Coordination Referal, Evaluation, and Acceptance Policy 

e Screening Tool for Outreach Coordinator 

e Special Health Care Needs Policy (C MFHP) 

e “Bringing It Together’ - 2007 Missoun Community Report 


INTERVIEWS 
Interviews were conducted with the following group: 


Plan Administration 
e Robert Finuf - Chief Executive Officer, Plan Administrator 
e Ma’ata Touslee - Director of Health Services 


e Jenny Hainey - Manager, Quality Management 
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e Kathy Ripley-Hake - Director, Provider Relations 

e Juanita Prieto - Manager, Provider Relations 

e Cindy Mense - Director, Customer Relations 

e Chris Beurman - Manager, Community Relations 

e Lisa Gabel- Manager, Clinical Services 

e Chad Moore - Compliance Officer 


e Dr. Elizabeth Peterson - Medical Director 


Member Services Sta ff 
e Ma’ata Touslee - Director of Health Services 
e Mark Van Blaricum - Compliance Officer 
e Cindy Mense - Director, Customer Relations 
e Steve Cupp - Member Services Sta ff 


e Paula McFall - New DirectionsMember Services 


Case Management Sta ff 
e Ma’ata Touslee - Director of Health Services 


e Mark Van Blaricum - Compliance Officer 

e Christy Roberts - Supervisor, Care Management 

e Amanda Caron - Case Management Outreach Coordinator 
e Alice Creager- Case Manager 

e Melody Dirks- Case Manager 

e Stephana McCullough - Case Manager 
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FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

The staff at Children’s Mercy Family Health Partners (CMFHP) continued to exhibit 
a strong commitment to ensuring that member rights were protected. The 
health plan utilized interpreter services, pre-translated written materials and a 
vanety of methods for those members who spoke a language other than English. 
The health plan provides altemativesto members who may have reading, vision, 
orhearing problems enabling them to obtain required information about the 
health plan orthe services they can expect to receive. Member Services staff 
set up altematives for individuals with any bamerto obtaining services and 


worked diligently to ensure that they receive necessary assistance. 


During 2005, CMFHP developed a tracking system to guarantee that all required 
matenalsand policy are reviewed on an annual basis, as required, and are 
submitted to the SMA ina timely manner. This process continued to be used 
during the 2006 and 2007 program years. This information continuesto be 
reviewed ona monthly basisand isstored ina locally maintained Access 
database. A quality committee reviews the database information quarterly to 
ensure that all updatesoccured timely. Member education and marketing 


materials were all submitted and approved early in 2007. 


CMFHP worked with an extemal contractorto develop applications of the 
ManagedCare.com software for their health information system. The company, 
using an intemal utilization management committee, initially looked at all parts of 
the CMFHP system and nanowezd the initial focusto ten areas. The 
ManagedCare.com database was implemented and operational in 2006. The 
system produces monthly analysis, trends, and utilization information that is 
initially used by Utilization Management. Trend analysis is provided to managers 
ona monthly basis. These reports have been an important tool formanagers in 


relation to both member and provider services. 
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During 2005 the CMFHP Member Advisory Committee was established. During 
2006 the health plan admits that they have struggled in maintaining regular 
attendance by members. They have provided transportation and other 
incentives with little success. Several ideas for membership based on information 
from otherMO HealthNet Managed Care health plans were provided and 
included foster parents and the use of a formermember who may have more 
resources Currently and be able to attend. The health plan exhibited its strong 
commitment to the advisory committee members and continues to send 
reminders. During the 2007 review it was leamed that the health plan has added 
consumer advocatesascommittee membersto enhance community 
generated information. Membership on this committee now includes school 
nurses, social workers, Head Start teachers, and Parents as Teachers advocates. 
Quarterly meetings of this group are continuing and attendance has improved 
significantly. Topics of these meetings included disease management programs 
and benefits. Information from the presentation wasincluded in a member 
newsletter, at the recommendation of a committee member. The committee 
has made suggestions, such aschanging marketing brochures, which have 
been implemented. Their advice and recommendations will be considered and 


utilized whenever possible. 


Children’s Mercy Family Health Partners continues to participate in community 
events including back-to-school fairs, work with area churches, the Chamber of 
Commerce, and eventstargeting the Latino and African American communities. 
They work with two groups specifically, El Centraland CoHo. A Latino staff 
member attends many of these eventsto ensure appropriate information is 
shared with members about accessto care. The local Latino radio station 


interviews sta ff and uses this information to promote events for their listeners. 


The YMCA posts information that reaches a number of minority communities in 
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the area. Free swimming is provided by Parks and Recreation and up to 500 
individuals attended one event at Swope pool. The health plan provides healthy 
snacks, and information on available servicesand local providers. The Case 
Managers participate monthly ina “concemed clergy” radio program 
sponsored by the “Ministerial Alliance” of African American pastors. This provides 
additional information on healthcare services to the community, aswell as 


education to members on the availability of providers and supportive services. 


Six Member Service representatives attended the interview. The discussion was 
spirited and displayed a sense of pride in the assistance this team providesto 
health plan members. They stressed that members are informed that they can 
utilize a PCP anywhere in the CMFHP Network. Methods were described that 
ensured the members who do not speak English are served adequately. 
Member Services phonesare equipped with a Spanish accesskey, and the 
health plan employs staff who speak Spanish. These staff exhibited a 
commitment to ensure that members are happy with their health care, and that 
they are willing to do extra work to ensure that the member hasa PCP they can 
trust, and are receiving the servicesavailable to them. The staff stressed that 
they ensure that members are aware of all plan benefits, including 
transportation. During the interview, one staff member shared that the previous 
day they contacted a member, who hasmissed several appointments, to ensure 
that this member was aware or transportation services, and to identify other 


bamiers to receiving services that might exist. 


Case Managers explained that they receive referrals formally and informally. 
They explore the listing received monthly from the SMA to identify all children 
with special health care needs. They also receive referals from providers, WIC, 
health fairs, Customer Services, OB risk assessment forms, pre-certification, 
utilization review, and from members themselves. The case managers stated 
that 80% of the Jackson County foster children utilize CMFHP as their designated 
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health plan. Efforts were made in 2007 to enhance referals for case 
management through Lunch and Leam Meetings at high volume obstetric 


offices. These efforts are viewed assuccessful and have continued in 2008. 


When a new referral is received it isreviewed within 48 hours. A review of 
utilization activity and claims activity is performed. A parent may be called for 
information and clarification if a child isinvolved. The case manager meets with 
the member, completesan assessment and formulatesa treatment plan. 
Permission is obtained from parents when a care plan iswnitten fora child. Case 
Managersare aware that a member may refuse these services. If a refusal 
occurs the case managers work within the system to assist the member without 
direct contact being required. The case managers also utilize a contract they 
have with Venzon, who provides mobile telephones. These phonescan be 
programmed so that the membercan only make calls to the case manager, 
transportation services, Pharmacy, mental health, the pharmacy and/or 911. Bills 


are then reviewed to ensure that members are making contacts appropriately. 


Ratings for Compliance with Enrollee Rights and Protections (100%) reflected 
policy and proceduresthat were submitted to and approved by the SMA forthe 
third consecutive year. All written information has been submitted and 
approved. All practice observed, as well as additional documentation viewed 


while on-site, indicated that the health plan is fully compliant in this area. 


Comparison (CMFHP) 


20052006 


part C: Enrollee Rights and Protections Yea 










Federal Regulation 





438.100(a) Enrollee Rights: General Rule 2 2 2 
438.10(b) Enrollee Rights: Information Requirements 2 2 2 
438.10(c)(3) Alternative Language: Prevalent Language 2 2 2 
438.10(c)(4,5) Language and Format: Interpreter 2 2 2 
Services 
438.10(d)(1)(i) Information Requirements: Format/Easily 2 

2 2 
Understood 
438.10(d)(1)(ii)and (2) Information Requirements: Format 2 2 2 


Visually Impaired, and Limited Reading Proficiency 
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438.10(f) Information for All Enrollees: Free Choice, etc. 2 2 2 
438.10 (g) Information to Enrollees: Specifics/Physician 2 2 3 
Incentive Plans 
438.10(i) Special Rules: Liability for Payment/Cost 2 > 2 
Sharing 
438.100(b)(2)(iii) Enrollee Rights: Provider-Enrollee 2 > > 
Communications 
438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 2 > 2 
Directives 
438.100(b)(3) Right to Services 2 2 2 
438.100(d) Compliance with Other Federal/State Laws 2 2 2 
Number Met 13 13 13 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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BEHAVIORAL HEALTH 

CMFHP began contracting with New Directions Behavioral Health (NDBH) forthe 
provision of behavioral health services for members during 2007. Interviews 
included a Member Services representative for NDBH. The approach to Member 
Servicesand case management by the BHO is very supportive of members, 
accepting of the need to provide adequate services, and doing so ina timely 
manner. NDBH is known for providing in-home services, and for contracting with 
a local provider who provides intensive in-home treatment for members to 
ensure that the family hasa full aray of in-home services and support. This 
service is extraordinary to those expected by the MO HealthNet Managed Care 
contract. These servicesare available to CMFHP members. The relationship 
between the health plan and the BHO iscollaborative and the examples 


provided indicate that it is very member focused. 


QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT 

Access Standards 

CMFHP continued to have a strong provider network throughout the Westem 
Region. The health plan has worked one-on-one with providers, including 
specialists who agreed to become panel members. The health plan recognizes 
a continued need forneurosurgeonsand orthopedic surgeons. CMFHP recruited 
several specialists who agreed to be in the network, but requested to remain 
silent and not be published in the ProviderManual. These providers saw 
members when contacted directly by health plan staff. CMFHP paid a higher 
fee to OB, orthopedic surgeons, urologists, and neurologists outside of Truman 
Medical Center staff to ensure adequate accessto these specialties. The health 
plan engaged Truman Medical Center in this process, to ensure that members 
were triaged and received a referal and provider access quickly. CMFHP 
continued to monitor their PCP availability and continued recruitment to ensure 


that adequate open panels were available. 
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Member Services staff reports that they do receive calls requesting PCP 

changes. The health plan began tracking members who requested changesin 
PCPs, pharmacy data, and emergency room utilization to identify if drug seeking 
wasa contributor to this problem. The monitoring produced some useful 
information. Several members chronically missed appointments and were asked 
to find a new physician. The health plan continues monitoring efforts to identify 


problems and to addressthem quickly and efficiently. 


The health plan continues to use member surveys and on-site reviews to monitor 
accessstandards. When deficiencies were identified they were dealt with in 
writing. Direct providercontact occured where required. Re-audits occurred to 


ensure that improvement was sustained. 


Member Services staff reports that they assist members with a number of access 
issues. They supply information on available providersand theirlocation. They 
instruct members on utilization of the handbook to identify providers, including 
those that speak other languagesor provide special services. If a provider 
contract isterminated, members receive a letter. Follow-up by telephone 
occurs, particulary ifa member's information indicates that they have literacy 
difficulties. Staff also discussed the efforts they make to assist member in 
obtaining copies of their medical records. If there isa problem with provider 
compliance, the Member Services staff intervenes, but also makesa referral to 


Provider Relations for follow-up. 


Case Managersalso become involved in assisting members in accessing 
appropriate medical care. They ensure coordination of services, and ensure 
that all levels of health care required are available. The CMFHP case managers 
meet quarterly with BHO case managersto ensure that they are serving clients 
appropriately when they have multiple service needs. Case managers also 


receive a listing twice a year that identifies all members who have not seen their 
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PCP ina year. Contactismade by letter, and additional outreach occursto 
ensure that health care servicesare received, and to identify changes that may 
be needed. 
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Ratings for compliance with Access Standards (100%) reflected completion of all 
required written policies and procedures for the third consecutive year. 
Observations and interviews that occured during the on-site review provided 
additional evidence that health plan practicesand operationsappearto be 
compliant with the MO HealthNet Managed Care Contract and federal 


regulations. 


Table 57 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (C MFHP) 





Federal Regulation leks 

438.206(b)(1)(i-v) Availability of Services: Provider Network 2 2 2 
438.206 (b) (2) Access to Well Woman Care: Direct Access 2 2 2 
438.206(b)(3) Second Opinions 2 2 2 
438.206(b)(4) Out of Network Services: Adequate and Timely 2 > 2 
Coverage 

438.206(b)(5) Out of Network Services: Cost Sharing 2 2 2 
438.206(c)(1)(i-vi) Timely Access 2 2 2 
438.206(c)(2) Provider Services: Cultural Competency 2 2 2 
438.208(b) Care Coordination: Primary Care 2 2 2 
438.208(c)(1) Care Coordination: Identification 2 2 2 
438.208(c)(2) Care Coordination: Assessment 2 2 2 
438.208(c)(3) Care Coordination: Treatment Plans 2 2 2 
438.208(c)(4) Care Coordination: Direct Access to Specialists 2 2 2 
438.210(b) Authorization of Services 2 2 2 
438.210(c) Notice of Adverse Action 2 2 2 
438.210(d) Timeframes for Decisions, Expedited Authorizations 2 2 2 
438.210(e) Compensation of Utilization Management Activities 2 2 2 
438.114 Emergency and Post-Stabilization Services 2 2 2 
Number Met 17 17 17 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 


Rate Met 100.0% 100.0% 100.0% 
Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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Structures and Operation Standards 

CMFHP members have open accessto specialists, with no referral from the PCP 
required. In some cases members receive assistance with referrals from health 
plan case managers. Whena memberhasa specific problem, and care 
coordination isneeded between clinicians, this service is provided by the 
appropnate case manager. The health plan initiated a formal means of 
facilitating communication between PCPsand specialists in 2006. They report 
that letters detailing care provided flow between the two. Case managers 
facilitate thiscommunication, with member approval, to ensure that pertinent 


information is shared. 


CMFHP formed a committee during 2007 to discuss the best methodology for 
making information about advance directives available to members. The goal 
wasto have this information available at PCP offices. Education and materials 
were provided to PCPson this topic. Two areasthat remained problematic were 
accurate completion of all required documentation and proper recording in 
medical records. The health plan continuesto work with PCP offices to improve 


these areas. 


CMFHP credentialing policies were reviewed. NCQA standardsare followed. 
Site visits and record keeping reviews are conducted on initial credentialing of 
PCPsand OB/GYNs. Re-credentialing isconducted every three years. Sanctions 
and quality are reviewed monthly. Credentialing policiesand procedures were 
approved by the health plan oversight committee, and were approved by the 
SMA in J une 2006. Information reviewed indicated that a delegated review of 
Truman Medical Center occured and no deficiencies were identified. 
Bridgeport, the dental subcontractor, was the subject of a delegated audit in 

J uly 2005 and no deficiencies were found. All these policies are procedures 


were continued during 2007. 
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The case managerscontinued to participate in an OB forum that began in 2005. 
They report having three or four successful meetings with good information 
sharing between case management staff and physicians attending. The Case 
Managers attend a forum in St. Louis annually. Thishas been a helpful tool in 


expanding their knowledge about issues that confront members. 
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Member Services staff discussed their awareness of issues such as members 
requesting disenrollment. They do enterthese requests into the health plan’s 
system, and assist the member through the process. Reason codesare tracked 
and reviewed at Oversight Committee meetings. They also seek feedback from 
the SMA regard disenrollment information to ensure that adjustments and 


changesare made if a service delivery issue isthe cause of these requests. 


The ratings for compliance with Structure and Operation Standards (100%) 
reflected complete policy and procedural requirements for the third consecutive 
year. The health plan appearsto be compliant with all policy and practice in 


this area that meets SMA contract compliance and federal regulations. 


Table 58 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (C MFHP) 


Federal Regulation 









2005 2006 
438.214(a,b) Provider Selection: 2 2 2 
Credentialing/Recredentialing 


438.214(c) and 438.12 Provider Selection: 2 







Nondiscrimination 2 2 
438.214(d) Provider Selection: Excluded Providers 2 2 2 
438.214(e) Provider Selection: State Requirements 2 2 2 
438.226 and 438.56(b)(1-3) Disenrollment: 2 2 2 
Requirements and limitations 

438.56(c) Disenrollment Requested by the Enrollee 2 2 2 
438.56(d) Disenrollment: Procedures 2 2 2 
438.56(e) Disenrollment: Timeframes 2 2 2 
438.228 Grievance System 2 2 2 
438.230(a,b) Subcontractual Relationships and 2 2 > 
Delegation 

Number Met 10 10 10 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 














Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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Measurement and Improvement 

CMFHP continued to be an active member of the Kansas City Quality 
Improvement Consortium (KCQIC) and utilized the practice guidelines 
developed and supported by that group. The local guidelines that were used by 
the health plan continued to meet or exceed nationally accepted standards. 
The KCQIC has developed guidelines on obesity treatment. CMFHP isnow using 
these guidelines. The health plan continued to utilize Milliman and Roberson 


guidelines for utilization management. 


CMFHP continues to send providersa quarteny report card covering lead and 
EPSDT rates. This is used asan incentive to increase the screening rates. Solo 
practice PCPs have the best rates in the health plan. They are reporting 
completion rates of 77%84%. The health plan is discussing adding additional 


HEDIS components to the report card in the future. 


CMFHP did submit two Performance Improvement Projects (PIPs) for validation. 
Specific details of these projectscan be found in the appropnate section of the 
report. Itwasnoted that the health plan utilized projects that had been started, 
and perfected these projectsin an effort to create improved servicesto 
members during the measurement year. These PIPs were well-constructed and 


provided adequate information for validation. 


The health plan submitted all required information to complete the Validation of 
Performance Measures, asrequested. CMFHP continued to operate a health 
information system within the guidelines of that protocol. All encounterdata 
requested wasprovided in the correct format. The details of each of these 


areasof validation can reviewed within specific sections of this report. 


Neither Case Managers or Member Services staff report having involvement in 


this portion of health plan operations. They were asked if members ever 
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requested practice guidelines. Both replied that they had not, but that if this 


occuned, orthere wasan identified need, this information would be shared with 


members. 
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Ratings forthe Measurement and Improvement sections were found to be 
(100%), which reflects that all required policy and practice meets the 
requirements of the MO HealthNet Managed Care contract and the federal 


regulations for the third consecutive year. 


Table 59 - Subpart D: Quality Assessment and Performance Improvement Measurement and 
Improvement Yearly Comparison (C MFHP) 








Federal Regulation 





2005 2006 












438.236(b)(1-4) Practice Guidelines: Adoption 2 2 2 
438.236(c) Practice Guidelines: Dissemination 2 2 2 
438.236(d) Practice Guidelines: Application 2 2 2 
438.240(a)(1) QAPI: General Rules 2 2 2 
438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCO 2 

: 2 2 
Quality Improvement and PIPs 
438.240(b)(2)(c) and 438.204(c) QAPI: Performance 2 2 2 
Measurement 
438.240(b)(3) QAPI: Basic Elements/Over and Under 2 2 2 
Utilization 
438.240(b)(4) QAPI: Basic Elements regarding Special 2 2 2 
Healthcare Needs 
438.240(e) QAPI: Program Review by State NA NA NA 
438.242(a) Health Information Systems 2 2 2 
438.242(b)(1,2) Health Information Systems: Basic Elements 2 
438.242(b)(3) Health Information Systems: Basic Elements 2 2 2 
Number Met 11 11 11 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: Regulation 438.240(e) refersto program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
process and isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable tot the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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Grievance Systems 

Ratings for compliance with the Grievance Systems regulations (100%) indicate 
that the health plan completed all requirements regarding policy and practice. 
This isthe fourth consecutive year that the health plan is fully compliant in this 


section of the review. 


An update occured in the health plan’s claims system during 2006. This resulted 
ina decrease in providercomplaints. There wasan inappropnate edit in the 
system causing complaints that resulted ina numberof overtumed decisions. 
This edit was removed and replaced with an appropnate edit and complaints 
decreased significantly. Timeframes forauthonzations were extended to 14 
days, asneeded to obtain additional information. Thisdecreased denials and 
providercomplaints as well. Currently the health plan has maintained a very low 


denial rate. 


Member Services staff was aware of the grievance processand related that 
they do provide assistance to members who contact them with concems. When 
a membercalls, the staff try to assist them so they know what questions to ask, 
and how to get answers to these questions throughout the gnevance process. If 
a member doesnot realize that theirconcem isa gnevable issue, the staff 
advises them further on negotiating this system and the importance of filing a 


gnevance. 


Case Managers report that they become involved when members receive an 
adverse authonzation decision. The case managers then referthe memberto 
the Grnevance/Appeal Department. Case managersare aware that the 
information is available in the Member Handbook, but assist members in any way 


that they can. 
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Table 60 - Subpart F: Grievance Systems Yearly Comparison (C MFHP) 


MCP 
Federal Regulation 
2005 2006 2007 
438.402(a) Grievance and Appeals: General Requirements 2 2 2 
438.402(b)(1) Grievance System: Filing Requirements - 2 2 2 
Authority 
438.402(b)(2) Grievance System: Filing Requirements - 2 2 2 
Timing 
438.402(b)(3) Grievance System: Filing Requirements - 2 > 2 
Procedures 
438.404(a) Grievance System: Notice of Action - Language 2 > 2 
and Format 
438.404(b) Notice of Action: Content 2 2 2 
438.404(c) Notice of Action: Timing 2 2 2 
438.406(a) Handling of Grievances and Appeals: General 2 2 2 
Requirements 
438.406(b) Handling of Grievance and Appeals: Special 2 
Requirements for Appeals 
438.408(a) Resolution and Notification: Basic Rule 2 
438.408(b,c) Resolution and Notification: Grievances and 2 2 
Appeals - Timeframes and Extensions 
438.408(d)(e) Resolution and Notification: Grievance and 2 2 2 
Appeals - Format and Content of Notice 
438.408(f) Resolution and Notification: Grievances and 2 2 2 
Appeals - Requirements for State Fair Hearings 
438.410 Expedited Resolution of Appeals 2 2 2 
438.414 Information about the Grievance System to > > 
Providers and Subcontractors 
438.416 Recordkeeping and Reporting Requirements 2 2 2 
438.420 Continuation of Benefits while Appeal/Fair Hearing 2 2 2 
Pends 
438.424 Effectuation of Reversed Appeal Resolutions 2 2 2 
Number Met 18 18 18 
Number Partially Met 0 0 0 
Number Not Met 10 0 0 
Rate Met 100% 100% 100% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol for determining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

Children’s Mercy Family Health Partners continues their strong commitment to 
meeting all policy, procedure, and practice areas of compliance with both the 
MO HealthNet Managed Care contract requirements and the federal 
regulations. The health plan exhibitsa meticulous attention to meeting all the 
details of the regulations, submitting policy and procedural updatesin a timely 
fashion, and utilizing the prior Extemal Quality Reviewsasa guideline for meeting 
required standards. The CMFHP staff exhibit a sncere commitment to 

excellence in serving MO HealthNet Managed Care members. They 
demonstrated respect and dignity toward members, while meeting their 
healthcare service needs efficiently and effectively. The health plan goes 
beyond the strict requirements of their contract to ensure that members are able 
to have a voice in the design of theirhealthcare system. The system created at 
CMFHP is responsive and strivesto assist its members in overcoming the baniers 
often encountered in the areas of quality, access and timeliness in obtaining 


healthcare services. 


QUALITY OF CARE 

CMFHP hasinitiated a numberof programsto ensure that members from the 
diverse population in theirarea have accessto providers and information in their 
language and ina manner that is understandable to them. They work diligently 
to ensure that providers are serving membersin a quality manner. The health 
plan monitors their service delivery system, including providers, regularly to 
produce quality services from the organization, and from the healthcare 
providers involved. CMFHP hasdemonstrated a number of creative approaches 
to engaging providers, partic ulany in hard-to-reach specializations. They actively 
engage new health management programs to benefit members. The health 
plan hasa strong relationship within the community and obtain feedback on 


their programs to ensure that quality care and services are achieved. 


C= Performance Management Solutions Group 403 
oe A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 


Performance Management Solutions Group 404. 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 
ACCESS TO CARE 

Children’s Mercy Family Health Partners demonstrates its commitment to ensuring 
access to care to members throughout their organization. Their focuson 
development and utilization of a Member Advisory Committee to ensure that 
members have a forum to disc uss access issues directly with the health planisa 
primary example. Their willingnessto assist members’ attendance, by creating 
reminders and providing transportation highlights this effort. The health plan 
demonstrates its sincerity in these efforts by implementing suggestions that come 
from these meetings. The health plan has also made many accommodations to 
ensure that members have accessto the aray of specialists they require to 


obtain quality healthcare services. 


TIMELINESS OF CARE 

The health plan has ensured that the treatment of members and providers during 
the gnevance and appeal process is of primary importance. They examine the 
reasons forgrevancesand appeals to ensure that their processes are not 
Causing a problem. If thisisthe case, the health plan is willing to take stepsto 
rectify the problem, thus ensuring that timely care takes place formembers. 
CMFHP continues their vigilant attention to continuous improvement within the 


organization and attention to improving servicesto members. 


RECOMMENDATIONS 
1. Continue to develop an organization that can exhibit energy and 
enthusiasm for its mission. 
2. Continue to actively monitor providersand subcontractors and to 
develop corective action initiatives when a problem is identified, such as 
advance directive utilization. 


3. Continue to look forcreative methodsto use as motivators, such as 
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available incentives, to encourage member utilization of health plan 


resources, particulary for high-risk populations. 


Performance Management Solutions Group 406 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 7 
Report of Findings - 2007 Children’s Mercy Family Health Partners 


(this page intentionally left blank) 


Performance Management Solutions Group 407 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 


8.0 Harmony Health Plan of Missoun 





Performance Management Solutions Group 408 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 


(this page intentionally left blank) 


Performance Management Solutions Group 409 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 


QPHARMONY’ 


8.1 Performance Improvement Projects 





METHODS 
DOCUMENT REVIEW 
Harmony Health Plan supplied the following documentation for review: 
e 2007 Medical Record Documentation by Primary Care Physicians and 
Their Staff, Interventions and Their Efficacy 
e 2007 Lead Screening 


INTERVIEWS 
Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on July 10, 2008 during the on-site 
review at the officesin Belleville, Illinois, and included the following: 

Heather Scalia - Director, Quality and Utilization Management 


Beverly Terveer - Quality Improvement Analyst 


The interviewees shared information on the validation methods, study design, 
and findings. Technical assistance regarding study design and presentation of 


findings was provided by the EQRO. The following questions were addressed: 


e Who wasthe Project Leader? 

e How wasthe topic identified? 

e How wasthe study question determined? 

e What were the findings? 

e What was the intervention? 

e What wasthe time period of the study? 

e Wasthe intervention effective? 

e What does Hamony Health Plan want to study or leam from their PIPs? 
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The PIPs submitted for validation included a substantive amount of information. 
Additional analysis has occured between the time of the original submission of 
information and the time of the on-site review. The health plan was instructed 
that they could submit additional information that included enhanced outcomes 
of the intervention. Additional clarifying written information was received after 


the on-site review from the health plan. 


FINDINGS 

The first PIP evaluated wasconsdered non-clinical and wasentitled “Medical 
Record Documentation by Primary Care Physicians (PC Ps) and Their 
Staff/Interventions and Their Efficacy.” The study topic presentation was 
supported by a literature review and a thorough explanation of the local 
problem. The topic discussion included results of the health plan’s initial review 
of PCP medical records, the results, problems identified, and the need for 
corrective action in this area of service. This PIP was the health plans non-clinical 
submission. The PIP wasrelated to improved servicesto members. The stated 
focus is that good medical records reflect good servicesto members. The 
documentation provided supportsthe stated goal that best practicesin record 
maintenance will improve providers’ ability to serve members’ health care 


needs. 


The primary study question presented was: “Will targeted health plan 
interventions in education of primary care physiciansand their office staff on 
medical record documentation increase the quality of physicians’ medical 
record documentation as measured by the WellCare Medical Record Review 
Tool used on initial Medical Record Review?” A secondary question wasalso 
presented: “By educating Primary Care Physicians and their office staff on 
medical record documentation after receiving lessthan 80%0n a Medical 
Record Review will Harmony Health Plan of Missoun be able to achieve 90% of all 
Primary Care Physicians passing a Medical Review Re-audit?” Thisisclearya 
technical and non-clinical study. The study question is complete although with 
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the introduction of the dual aspects of the two study questions the processis 
complicated. It does identify the intended resolution or outcome in terms of 


increasing the overall outcome or results of medical records review. 
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Indicators are well defined and constructed to provide measures of 
improvement. The indicators are measures of success. However, the 
introduction of the second indicator doeslead to some confusion. The first 
indicator is actually a baseline measure: the numberof PCPs that pass their 
initial record review with a score of 80% orgreater in comparison to the total 
number of PC Psthat have had a Medical Record Review in the same 
measurement year. The second indicatoris: The percentage of PCPs passing 
their medical record re-reviews with a score of greaterthan 90% or more in 
comparison to the total number of PC Psthat have had a Medical Record re- 
review in the same measurement year. These indicators are attempting to focus 
on all areasthat measure systemic improvements in the medical record review 
process. The indicatorsdo provide a concrete measurement. The same tool will 
be utilized forthe orginal measurement and the re-measurement. However, the 
information presented does lead to some confusion overthe difference in 
comparison percentagesand how they relate to one another. The information 
provided does indicate that the indicators measure a change in the process of 
Care with a strong association on improved outcomes. The project doesnot 


exclude any members. 


The actual study population is all credentialed network PCPs. The recordsto be 
reviewed will come froma random sample based on providers with fifty (50) to 
one hundred (100) enrolled MO HealthNet members. The method for 
determining PCPsto be included in the sample wassound and credible. All 
sampling techniques were detailed including the rational for the confidence 


interval utilized. 


The data collection and analysis process is provided in specific detail. The data 
to be collected was defined in the narrative. The health plan included a 
description of how information isgathered and tracked on their intemal system. 
All the tools used in completing the medical record review, and the health plan’s 
expectations fora complete record are provided. Sourcesof data are 
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described and samplesare included. The study design specifies the use of clear 
identification of all data to be collect, the source of date, how baseline data is 
determined, and how repeat measures will be used that will ensure valid and 
reliable data. A specific medical record abstraction tool is being used and a 
sample wasavailable for review. The data collection will occur quarterly, and is 


analyzed yeanly. 


Performance Management Solutions Group 414 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 
In the original submission the PIP documentation did not include a prospective 
data analysis plan. The enhanced information received after the on-site review 


did include a detailed analysis plan. 


Planned interventions were described in detail in the information provided. The 
study was initiated in 2007, which provided baseline information and results. 
Improvement strategies were realistic and appeared to be based on improving 
identified problem areas. The results though 2007 and planned changesto 
enhance the study in 2008 were included. The data obtained forthe 2007 
baseline year were included. The description of the data and the analysis were 
discussed in a mannerthat related it to the orginal data analyssplan. The 
analysis did identify the initialand repeat measurements. At the time of the 
evaluation it was not possible to identify real orsustained improvement. It should 
be noted that the project has real promise for improving PCP functions and 


therefore positively affecting servicesto members. 


The second PIP evaluated wastitled “Lead Screening Performance 
Improvement.” This study wasconsidered clinical and focused on improving the 
rates of lead screening for young children agesO- 2. The project narative 
cleanly identified how compliance improving the screening process isrelated to 
availability of preventive services formembersand improved healthcare 
outcomes. The decision to enact this tudy was well defined and supported by 
both state and national data sources. The information presented wasbased on 
a substantial literature review that compared both national and regional 
standards. Thisreview and analysis provided a substantial argument forthe topic 
choice, and also forthe interventions identified. The approach to this 
Performance Improvement Project was not just to presenta clinical study, but to 
implement successful interventions to improve health care service to members 
with the overarching goal of improving health outcomes for the children 
affected. 
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The study question presented was “Will targeted health plan interventions in 
education of providersin the guidelines of lead screening and testing, and 
parents of members that are children agesone (1) day to twenty-four (24) 
months, along with a Paid for Quality Program (PFQ) for Primary Care Physicians 
increase the numberof lead screening in member who are children in the 
following categories: 1) the first year of life; 2) The second year of life; 3) In the 
first and second year of life.” The question framed the content and intention of 
this study. Indicators for this study were included and defined with substantive 
information about how they were to be counted and analyzed. The indicators 
did include NCQA quantifiable information. The information provided clearly led 
the readerto understand that the focus of the study isto improve compliance 
with recommended lead screening guidelines in an effort to improving health 
outcomes for children. The population served by this study includes all members’ 
Children in the age range and doesnot exclude any member with special health 


care needs. 


The data collection methodology wasincluded. Data willbe obtained from 
programmed pulls from claimsand encounter files. Data sources were 
described in detail. These planned pulls are to occurone time peryear. The 
enhanced information provided did attempt to describe a study design with 
enough detail to ensure that there is confidence in the plan and the process. 
The additional information does supply information on the data collection 
processand accurate data collection overtime. By limiting the collection and 
analysis to an annual cycle it will not allow the health plan to make any changes 
or adjustments throughout the project yearthat may have a positive impact of 


expected outcomes. 


A prospective data analysis plan wasnot specifically included, but could be 
inferred in the additional information received. Additional detail would be 


helpful in this aspect of the project. 
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A description of the planned interventions was included for the 2008 project 
year. The interventions planned are focused on education to providers and their 
staff, and to parents of membersthat have not reached theirsecond birthday 
and are still in need of lead screening. How the various interventions will impact 
member behavioris not defined. Bariers and other issues that may affect 


outcomes were not identified or were not included in the information provided. 


The desired outcomesand the evaluation process were included. The ultimate 
goalsof the proposed interventions were detailed in the information submitted. 
The project hasnot reached a level of maturity that enables any evaluation of its 


success at this point. 
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CONCLUSIONS 


QUALITY OF CARE 

Both PIPs seek to improve the quality of servicesto members. The non-clinical PIP 
seeks to improve the how servicesare recorded formembers enabling providers 
to have accurate and complete medical recordsformembers. The 
interventions described in the clinical PIP are clearly targeted to improve the 
quality and effectiveness of preventive services for children improving health 
care outcomes. By educating providersand membersin accessing available 
and appropnate lead screening services, the health plan will ensure that 


preventive and the most effective services will be in place. 


ACCESS TO CARE 

The clinical PIP had a specific focuson accessto care. The study sought to 
ensure that members who were eligible for lead screening received these 
servicesin an efficient manner. By undertaking the methodology involved in the 
Performance Improvement Project the access to care will enhance the 
members’ ability to appropriately utilize these services. The non-clinical PIP also 
included the theory that improving medical recordsin an effort to improve 
information available in members’ medical history will improve the care 
available. The narative did make the case to ensuring that thisgoal was 
addressed through the PIP process. The goalsand their relationship to the 


problems addressed were included in the narrative included. 


TIMELINESS OF C ARE 

The services and interventions used in the clinical PIP did have the specific 
outcome of improving the timeliness of appropriate preventive services for 
children. In this PIP the areas of access, quality, and timeliness of care were of 


the utmost importance. The outcome was focused on improving the availability 
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and awareness of the need for services so they would be received ina timely 
manner. The non-clinical PIP considered timeliness in looking at efficient and 
effective information available for all members. The narrative provided 
disc ussed how these new and improved processes would improve timely services 
to members asthe result of the PIP interventions. It should be noted that timely 
accessto Care waSa stated and implied goal of both projects. 
RECOMMENDATIONS 
1. Harmony Health Plan has attempted to improve the timeliness, quality, 
and accessto care for members requiring health care servicesin the 
process of each of these Performance Improvement Projects. The focus 
on improving servicesto members through the PIP process needs to be 
reflected in the outcome of these studiesto ensure that these goals are 


met in and efficient and effective manner. 


2. The health plan should explicitly address how their projects are extended 


to and pertinent to the entire Region served. 


3. The health plan should indicate how these activities will be incorporated 
into regular agency processesif they indicate success. Thisisan 
important aspect of the PIP processand should occurto ensure that 


improvements continue on a sustained basis. 
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8.2 Validation of Performance Measures 


Harmony Health Plan had not been in operation in Missoun fora long enough 
period to provide data forthe HEDIS 2007 Extemal Quality Review. Therefore, no 
performance measures were evaluated. However, this plan’s performance 


measure data will be validated and assessed in the 2008 Extemal Quality Review. 
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8.3 Validation of Enc ounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical elds? 


Forthe Medical claim type, there were 1,623 encounterclaims paid by the SMA 

forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete, accurate 
and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete, accurate 
and valid. 

5. The Outpatient Units of Service field was 100.00% complete, accurate and 
valid. 

6. The Outpatient Procedure Code field 100.00% complete, accurate and valid. 

7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. The second through fifth Diagnosis Code fields are optional according to the 
Health Plan Record Layout Manual. Each of these Diagnosis Code fields fell 
well below the 100% threshold established by the SMA for this validation. The 
second, third, fourth and fifth Diagnosis Code fields were 51.20%, 28.53%, 
19.59%, and 0.00% complete, accurate and valid, respectively. The 
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remaining fields were blank (incomplete, inaccurate, and invalid). 


Forthe Dental, Home Health, Pharmacy and Inpatient claim types, there were 
zero (0) encounterclaims paid by the SMA forthe period J uly 1, 2007 through 
September 30, 2007. 


For the Outpatient Hospital claim type, there were 6 encounterclaims paid by 
the SMA forthe period J uly 1, 2007 through September 30, 2007. All fields 
examined were 100.00% complete, accurate, and valid except forthe second 
through fifth Diagnosis Code fields. The second, third, fourth and fifth Diagnosis 
Code fields fell well below the 100% threshold for completeness, accuracy, and 
validity established by the SMA (16.67%, 0.00%, 0.00% and 0.00%, respectively). 


The remaining fields were blank (incomplete, inaccurate, and invalid). 


What Types of Encounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for Harmony Health Plan of Missouri 
,an error analysis of the invalid entries was conducted for fields which were 
lower than the 100.00% threshold specified by the SMA. All critical fields were 
100.00%. 


What is the Level of Volume and Consistenc y of Servic es? 

When comparing the rate of encounter claim types per 1,000 members, 
Harmony Health Plan of Missouri demonstrated rates statistically lower than the 
average forall MO HealthNet Managed Care health plans for all claim types. 
This was the first yearthat Harmony participated in the EQRand they had some 


issues with compatibility between their encounter claims system and that of the 
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To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each health plan were randomly 
selected from all claim types forthe period J uly 1, 2007 through September 30, 


2007 for medical record review. 


Of the 1,629 encounter claim types in the SMA extract file for) uly 1, 2007 through 
September 30, 2007, 100 encounters were randomly selected. Providers were 
requested to submit medical records for review. There were 91 medical records 
(91.0%) submitted for review. Encounters for which no documentation was 
submitted were unable to be validated. The match rate for procedures was 
45.0%, with a fault rate of 55.0%. The match rate for diagnoses was 36.0%, with a 
fault rate of 64.0% 
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What Types of Enors Were Noted? 

An enor analysis of the errors found on the medical record review for procedure 
and diagnosis was conducted. Forthe diagnosiscode in the medical record, 
the reasons for diagnosis codesnot matching the SMA extract file were missing 
information (n =56) and incorrect code found (n=8). Forthe procedure code in 
the medical record, the reasons for procedure codesin the SMA extract file not 
being supported by documentation in the medical record were missing 
information (n =30), incorrect code (n=12) and upcoded (3). Examplesof 
missing information included no code; codes listed that were not supported, or 
codes that did not match the procedure description. Examples of incomect 


information included global pregnancy codes billed separately. 


To what extent do the MO HealthNet MC HP paid/ unpaid enc ounter claims match 
the SMA paid database? 


Since Harmony Health Plan included intemal control numbers that matched 
those of the SMA, the EQRO conducted the planned analysescomparing MO 
HealthNet Managed Care health plan encounter data to the SMA encounter 
Claim extract file. The SMA defined “unpaid claims” as those claimsthat the 


health plan denied for payment, unpaid claims do not include claims paid via a 





capitation plan. 


For Inpatient Claim Type 0 “paid” encounters 4 “unpaid” claims were submitted. 
All paid encounter claims matched with the SMA encounter claim extract file. 
The 4 unpaid claims were not present in the SMA database (asexpected); there 
wasa “hit” rate of 100.00% between Harmony encounter claims and the SMA 


encounter data. 


Why are there unmatched claims between the MO HealthNet Managed Care 
health plan and SMA data files? 


The unmatched encounters are due to missing ICN numbers which are required 
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to match the encounterto that of the SMA. Therefore, in all claim types, the 


encounter claims were legitimately missing from the SMA extract data. 
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What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 

While the MO HealthNet Managed Care health plan did submit the data in the 
requested format (including most ICN numbers), there are a numberof ways to 
improve the data quality by improving the database system. Asthe Intemal 
Control Numberis only assigned by the State database when a claim is paid, it is 
diffic ult to match the MO HealthNet Managed Care health plan data of 
“unpaid” and “denied” claimsto the SMA data. Asthe Intemal Control Number 
is unique only to the encounter, the ICN may be represented in multiple lines of 
data. To match the MO HealthNet Managed Care health plan data to the SMA 
data to specific fields, this requires a unique line number. Therefore each service 
provided within an encounter would have a separate line of data with a unique 


line identifier. 


CONCLUSIONS 

STRENGTHS 

1. Encounterdata wassubmitted to the EQRO in the requested format which 
allowed encounter validation forall claim types. 

2. The critical field validation of all claim types submitted resulted in few fields 
under the SMA established threshold of 100.00% accuracy, completeness, 
and validity. 


AREAS FOR IMPROVEMENT 
1. The rate forall six encounter claim types was significantly lower than the 


average forall MO HealthNet Managed Care health plans. 


RECOMMENDATIONS 

1. Examine and revise asneeded intemal system edits for invalid procedure 
codes in the UB-92 file layout for the Outpatient Procedure Code and 
Discharge Date fields 
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2. Run validity checksafter the programming of new edits. 

3. Continue to work with the SMA to resolve the compatibility issues between 
the Encounter claims system so that the MCHP can submit and be paid forall 


member encounters. 
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8.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Harmony Health Plan of Missoun is in its second year of operation asa MO 
HealthNet Managed Care health plan. It began operations in the State of 
Missoun, upon receiving a contract with the MO HealthNet Division (MHD) on J uly 
1, 2006. A full compliance audit wasnot conducted on Harmony Health Care in 
2006. During 2007 the health plan did submit policy and procedures for review 
by the State Medicaid Agency (SMA). Priorto the site visit, documentation was 
received and reviewed regarding the health plan’scompliance with the State 
contract. The Extemal Quality Review Organization (EQRO) reviewed contract 
documents with the staff of the MHD. On-site review time was used to conduct 
interviews with those who oversee the daily activities of the health plan to 
ensure that the practicesthat are in place are within the scope of the contract 


and are conducted in a manner that meets or exceeds federal regulations. 


A detailed protocol (BHC MO HealthNet Managed Care Health Plan 
Compliance Review Scoring Form) wasutilized to review policy compliance by 
the health plan. Additional document review occured prorto the on-site 
review. The health plan also assisted by providing additional documents for 


review after the date of the on-site review. 


On-site review time wasused to conduct interviews with Member Services’ Sta ff 
and Supervisors, and separately with Case Management Staff and Supervisors. 
This approach wasutilized to validate the practicesoccuning when serving 
members. These interactionsand responses were compared to policy 
requirements to ensure that both are within the scope of the contractand are 


conducted in a manner that meets or exceeds federal regulations. 


A detailed interview tool, individualized forMember Services’ Staff and for Case 
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Management staff, was utilized to ensure that all pertinent elements of the 
federal regulations were addressed in the interview process. Additionally, an 
individualized interview tool was constructed foradministrative staff to validate 
and clarify these practices and to follow-up on questions raised from the 
interviews. 
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Additional document reviews occured after the on-site review to validate any 

policies and procedures that were in question after disc ussions with the SMA, and 


afterthe review of the health plans annual report. 


DOCUMENT REVIEW 
The Division of Medical Services supplied: 
e State of Missoun Contract Compliance Tool (including MHD responsesand 


comments) 


The following documents were requested for on-site review: 
e Member Handbook 

e Provider Handbook 

e 2006 Marketing Plan and Matenals 

e Policy Tracking Log 

e Staff Training Log 

e Credentialing Policiesand Audit Reports 


e Grievance Logs(Memberand Providers) 


Additional documentation made available by Harmony Health Plan included: 
e Marketing Plan and Educational Material Development Policy 

e 2006 Marketing Matenals 

e Harmony Care Organizational Chart 

e Quality Improvement Program Description 2007-2008 

e Harmony Health Plan of Missouri Program Description Binder 
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INTERVIEWS 


Interviews were conducted on-site at Harmony Health Plan’s Belleville, Illinois 


officeson July 19, 2007 with the following groups: 


Plan Administration 


Heather Scalia - Director, Utilization Management and Quality Improvement 
Carol Ouimet - Manager, Regulatory Affairs 

Bevery Terveer - QI Analyst 

Teresa Soria - Social Service Specialist 

Dr. Tammaji Kulkami - Medical Director 

Tina Gallagher - Executive Director 

Steve Aguirre - Director, Operations 

Maresa Corder - Senior Director, Disease and Case Management 
Brian Gibson - Manager, Case Management 

Brenda Bryant - Senior Provider Relations Representative 

Camella Hardnet - Manager, Community Relationsand Marketing 
Bill Gaither - Document Control Specialist 


Jason Bollent - Sr. Manager, Medicaid Customer Services 


Member Services Sta ff 





C 


Steve Aguirre - Director, Operations 

Kendra Graham (T) - Member Services Representative 

Bill Gaither - Document Control Specialist 

Carol Ouimet - Manager, Regulatory Affairs 

Jason Bollent (1) - Sr. Manager, Medicaid Customer Services 
Cary Izquierda - Customer Services Staff 


Grise Gallegas - Customer Services Sta ff 


ase Management Sta ff 





Brian Gibson - Manager, Case Management 


Kevin Cassidy (1) - Case Manager 
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e Robin Clark (T) - Case Manager 

e Carolyn Mather (T) - Case Manager 

e Jeff McCann (T) - Case Manager 

e Leslie Reseman (T) - Case Manager 

e Doug Quinto (T) - Case Manager 


e Heather Scalia - Director, Utilization Management and Quality Improvement 


FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

Harmony Health Plan of Missoun isa part of WellCare Health Plans, Inc., due to a 
cormorate merger that occured in 2004. Harmony hasbeen providing Medicaid 
Managed Care Services in states other than Missoun fora number of years. The 
behavioral health organization providing services through August 2007 was Psych 
Health, a subcontractor. The health plan reported that another WellCare 
subsidiary, Harmony Mental Health, assumed responsibility for providing 


behavioral health services on September 1, 2007. 


The health plan reported having approximately 11,000 membersat the time of 
the on-site review. The predominant population is pregnant women, according 
to Harmony data. The majority of members resided in St. Louis City and County, 
but their member population was slowly expanding to the adjoining counties. 
The health plan hasa goal of upgrading their service delivery system and 
ensuring that staff and programs provide quality care for their curent members. 
The health plan reports that they are aware of the need to have culturally 
diverse staff and providers. They are contracted with Language Access Metro 
Project (LAMP) forinterpreter services. They are able to translate written 


matenals asneeded. 


Harmony does have an active Obstetrics Program for pregnant women. They 


send out OB notification forms, conduct direct member outreach, and complete 
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a thorough needs assessment. Home visits occur for members identified as high 
risk. The health plan reports that it makes an immediate referral for behavioral 
health services when a need is assessed, and also makes referrals for postpartum 
support. The Harmony network does include Peoples Clinic and Grace Hill, two 
St. Louis Federally Qualified Health Centers (FQHCs). The health plan regards 
their relationship with the FQHCsasvital to ensuring adequate accessto care for 
members. The provider representatives conduct monthly visits to the FQHCsto 


maintain this resource. 
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The health plan medical director, Dr. Tammaji Kulkami, MD, gave a presentation 
regarding the health plan’sgoalsand philosophy. He shared that the health 
plan strivesto promote a culture of compliance. Itisthe health plan’s goal to 
improve community partnerships, to enhance staff engagement and to laya 
ground work for future growth. They seek to serve their current members 
successfully, while achieving targeted growth in enrollment. The health plan 
seeks to maintain a multi-disciplinary approach to oversight and quality 
improvement activities. They seek to continue to improve communication with 


members and providers. 


The health plan operatesa Customer Service/Quality Improvement Group, 
which reviews grievancesand appeals, enrollment issues, and authorizations. All 
of these committees report to the Harmony Quality Committee for Missouri and 
Illinois. The health plan has also embarked on community outreach. They are 
involved with the Boysand Gins Clubsin the Westem Region, and operate a 


birthday club for children in their membership. 


The health plan hascustomer service staff that is assigned to their Missoun 
population based in Chicago, Illinois. They have back-up staff available from 
the Illinoisand Kentucky programs, which have been trained on the MO 
HealthNet Managed Care program. Harmony nursing staff, as well as their 
Pharmacy Director, has met with physiciansin Missoun. During these visits they 
promoted the EPSDT program and encouraged the completion of screenings, 
and assessments to assist in the identification of members with special health 


care needs. 


The case management team is located at the health care facility in Tampa, 
Florida. Case management includes lead, special health care needs, and 
intensive case management. Members receive case management at their 
request orif referred by a provider, hospital staff, or from the information listing 


received from the SMA. 
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Member Services staff related that calls received in their department were 
usually for PCP changes. They search on-line for providers who may be near the 
memberslocation. They utilize the member's area code and provide namesof 


PCPs that are nearest their location. 


Case Managers report that their section, utilization management and disease 
management are provided from the Tampa, Florida offices. Disease 
management is available for diabetes, CHF, and asthma. These servicesare 
supported by a fully integrated data program forsharing information between 
case managers, disease management staff, medical staff, pharmacy and 
behavioral health staff. The interactive communication system providesa 
preliminary screen for case managersor disease managers, and contains real- 
time information to the users. Referralsto the case management program come 
from a variety of sources including physician referrals, data mining through 
claims and prenatal reports, the Missouri enrollment broker, daily hospital census, 
Member Services, and self referrals. Special needs casesare identified through 
claims fordurable medical equipment, pharmacy, and diagnosscodes. The 
health plan also operates an outreach program for pregnant members. Clinical 
assessments are completed using the health plan’s information system with a 
guide that triggers questions, includes behavioral health needs, and a 


stratification that setsa level of need for follow-up. 


The rating for Enrollee Rights and Protections (69.2%), reflects a lack of complete 
and approved policy and procedures. Itisto be noted that thisisthe health 
plan’s first full compliance review. They have submitted policy to the SMA and 
are working to complete the approval process required. They had not 
established tracking and intemal processes at the time of the on-site review. 
Harmony Health Plan exhibited a businesslike approach and commitment to 
continue their efforts to improve in the completion and submission of required 
policies and procedures that will comply with the MO HealthNet Managed Care 


Gea Performance Management Solutions Group 435 
erie A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 


contract. They have a stated goal of partnering the State agency (MHD) to 


ensure compliance in thisand all areasof policy development. 
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Table 61 - Subpart C: Enrollee Rights and Protections Yearly Comparison (Harmony Health Plan) 
Harmony 





Federal Regulation 


438.100(a) Enrollee Rights: General Rule 
438.10(b) Enrollee Rights: Information Requirements 

























438.10(c)(3) Alternative Language: Prevalent Language 
438.10(c)(4,5) Language and Format: Interpreter 
Services 

438.10(d)(1)(i) Information Requirements: Format/Easily 
Understood 

438.10(d)(1)(ii)and (2) Information Requirements: Format 
Visually Impaired, and Limited Reading Proficiency 
438.10(f) Information for All Enrollees: Free Choice, etc. 1 


438.10 (g) Information to Enrollees: Specifics/Physician 


Incentive Plans c 
438.10(i) Special Rules: Liability for Payment/Cost > 
Sharing 

438.100(b)(2)(iii) Enrollee Rights: Provider-Enrollee 0 


Communications 
438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 
Directives 


438.100(b)(3) Right to Services il 
438.100(d) Compliance with Other Federal/State Laws 2 
Number Met 9 
Number Partially Met 3 
Number Not Met 1 
Rate Met 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT 

Access Standards 

Harmony Health Plan of Missouri continuesto make an effort to improve in the 
area of accessstandards. The health plan has submitted policies and 
proceduresto the SMA for annual review as required. They are actively working 
to increase their provider panel throughout the Eastem Region. Additional work 
with providers includes educating them regarding the HEDIS measures, and 
emergency room utilization. The health plan marketing department is 
continuing with network development and report that thishas been challenging. 


They have struggled in engaging physicians in the counties outside of St. Louis, 
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but are still competitive there. The SSM Health Care system has contracted with 
the health plan. 


Member Services staff report that when a member reports diffic ulty in obtaining 
accessto their PCP, their medical records, orin obtaining an appointment, they 
contact the PCP office and intervene on the member's behalf. When members 
calland report that they have difficulty obtaining services after-hours or on 
weekends, the member is provided with information on accessing urgent care 
centers and the nurse-advice line. Member Service staff try to resolve the 
problem and document information, which is then forwarded to the Provider 
Services and/or Grievance Departments. Member Services staff report that if 
they receive a call foremergency services, that they “assist asneeded” and 


arrange transportation as required. 


Case Managers relate that they do assist members in obtaining appointments 
and locating the health care services they require. They also discussed how they 
handle situations when a member reports receiving an adverse action decision 
to an authonzation. The Case Manager explains member benefits, and assists 
the member in contacting the Appeals Department. The case manager remains 
on the telephone with the memberand providesadvocacy and assists as 


needed. 


Ratings for compliance with Access Standards (52.9%) reflect the efforts by the 
health plan to submit complete required policy to meet the requirements of the 
MO HealthNet Managed Care contract and federal regulations. Thisis the first 
yearthat all required policy and procedure are completed and submitted for 
the approval process. Harmony Health Plan voiced their willingness to continue 
their effortsto develop necessary policy and practice to be in full compliance 
and to obtain full compliance. Observations made at the time of the on-site 
review indicated that these efforts were continuing and full compliance wasan 
ongoing health plan goal. 
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Table 62 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (Harmony Health Plan) 





Federal Regulation Harmony 


2007 


438.206(b)(1)(i-v) Availability of Services: Provider Network 
438.206 (b) (2) Access to Well Woman Care: Direct Access 


438.206(b)(3) Second Opinions 


438.206(b)(4) Out of Network Services: Adequate and Timely 
Coverage 


438.206(b)(5) Out of Network Services: Cost Sharing 
438.206(c)(1)(i-vi) Timely Access 

438.206(c)(2) Provider Services: Cultural Competency 
438.208(b) Care Coordination: Primary Care 

438.208(c)(1) Care Coordination: Identification 
438.208(c)(2) Care Coordination: Assessment 

438.208(c)(3) Care Coordination: Treatment Plans 
438.208(c)(4) Care Coordination: Direct Access to Specialists 
438.210(b) Authorization of Services 

438.210(c) Notice of Adverse Action 

438.210(d) Timeframes for Decisions, Expedited Authorizations 
438.210(e) Compensation of Utilization Management Activities 
438.114 Emergency and Post-Stabilization Services 

Number Met 

Number Partially Met 

Number Not Met 

Rate Met 52.9% 
Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 


Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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Structures and Operation Standards 

Harmony Health Plan of Missouri continuesto develop their credentialing 
standards. The health plan assured the EQR that all providers maintained 
licensure and the nght to practice in Missoun. The health plan developed a work 
plan to ensure that the remaining provider list would be current during the 
coming year. The health plan reported that they are current on all providers due 


forcredentialing. Delegated credentialing is utilized but Harmony provides strict 
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oversight of these functions. 


The health plan operatesa dedicated quality improvement program that utilizes 
an active Medical Advisory Committee. They also operate physician outreach 
and education programsto enhance their ability to communicate and support 
providers. Thisincludes one-on-one physician education sessions, as well as 
group training sessions. They utilize provider newsletters and other outreach 
activities to provide information and feedback to the provider network. 
Harmony Health Plan has also developed a “Pay for Quality (PFQ) Program” for 
providers. This program is measured by NCQA/HEDIS standards. 


Member Services staff report a sound knowledge of the policiesand procedures 
to utilize ifa health plan member calls and requests disenrollment. They do ask 
questions to reason with members and to identify the type of problem and ifa 
resolution is possible. The staff relate that they often find that the genesis of the 
Call is dissatisfaction with a provider. When they can assist with the problem they 
often find that the resolution creates an environment where the member no 
longer wishesto pursue disenrollment. If a member persists in their wish to 


disenroll, the member services staff assists them through this process. 


Care Managers related that they were not directly involved in this aspect of 


health plan operations. 


The rating for Structure and Operation Standards (70%) reflects the efforts the 
health plan has made for their first submission of policy to the SMA for their review 
and approval. It appears that all required policy has been submitted but isin the 
revision and approval process. The health plan understood that continued 
efforts in this area of practice willbe needed. Observationsat the time of the 
on-site review support that Harmony Health Plan of Missour, hasa commitment to 


completing and improving areas that may be viewed as problematic. 
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Table 63 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (Harmony Health Plan) 






Harmony 

















Federal Regulation 






438.214(a,b) Provider Selection: 
Credentialing/Recredentialing 
438.214(c) and 438.12 Provider Selection: 
Nondiscrimination 


438.214(d) Provider Selection: Excluded Providers 


438.214(e) Provider Selection: State Requirements 


438.226 and 438.56(b)(1-3) Disenrollment: 
Requirements and limitations 


2 
2 
2 
438.56(c) Disenrollment Requested by the Enrollee 2 
438.56(d) Disenrollment: Procedures 2 
438.56(e) Disenrollment: Timeframes 2 

1 


438.228 Grievance System 


438.230(a,b) Subcontractual Relationships and 
Delegation 


2 
Number Met 7 
Number Partially Met 3 
Number Not Met 0 
Rate Met 





Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Measurement and Improvement 

Harmony Health Plan hasdeveloped and implemented specific practice 
guidelines with providers at the time of the 2007 review. The health plan hasnow 
instituted the National Heart, Lung, and Blood Guidelines for asthma care for 
adultsand children. Thisinformation and the methods to utilize these guidelines 


have been distributed to all health plan providers. 


Harmony Health Plan has instituted a number of Quality Assessment and 
Performance Improvement activities during 2007. Their Quality Improvement 
group meets regulary and includes local physicians who actively participate. 


The health plan’s goal of providing quality servicesto members was the focus of 


Ge: Performance Management Solutions Group 442 
einer Pac mC A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 8 
Report of Findings - 2007 Harmony Health Plan of Missouri 
the group’s discussions. The Quality Improvement section isan active and 
essential section of health plan operations. The health plan plans to use the 
quality improvement processto ensure that all members have adequate access 
to services, timely and appropnate services, and also to improve relationships 


and support of providers. 
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Case Managersand Member Services Staff report that they have not been 
asked by members for access to information, such as practice guidelines. Both 
groups knew that this information was available and could be accessed for 


members if needed. 


Harmony Health Plan did submit two well-constructed Performance 
Improvement Projects (PIPs) for validation. Although these PIPslacked complete 
matunity to allow for validation, they indicated that the health plan does utilize 
this process asa tool forhealth plan growth. The structure of both PIPs followed 
the federal protocol and showed a great deal of potential. These PIPs indicated 
an understanding of the importance of the PIP processin improving health plan 


operations and health care servicesto members. 


The health plan wasnot required to submit information for Validation of 
Performance Measuresasthey will not be required to complete HEDIS 
documentation until the 2008 service year. Harmony Health Plan continued to 
operate a health information system within the guidelines of that protocol. All 
encounter data requested was provided in the corect format. The complete 
details of each of these areas of validation can be reviewed within spec ific 


sections of this report. 


The rating forMeasurement and Improvement (36.4%) reflects the fact that this is 
the initial submission of policy and procedures forthe health plan. The health 


plan is actively engaged in the revision and approval process with the SMA. 
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Table 64 - Subpart D: Quality Assessment and Performance Improvement Measurement and 
Comparison (Harmony Health Plan) 




















Harmony 
Federal Regulation 


438.236(b)(1-4) Practice Guidelines: Adoption 





438.236(d) Practice Guidelines: Application 


438.240(a)(1) QAPI: General Rules 

438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCO 
Quality |mprovement and PI Ps 

438.240(b)(2)(c) and 438.204(c) QAPI: Performance 


2 
438.236(c) Practice Guidelines: Dissemination 2 
2 
Al 


Measurement Z 
438.240(b)(3) QAPI: Basic Elements/Over and Under 1 
Utilization 

438.240(b)(4) QAPI: Basic Elements regarding Special 1 


Healthcare Needs 
438.240(e) QAPI: Program Review by State NA 
438.242(a) Health Information Systems i 
438.242(b)(1,2) Health Information Systems: Basic Elements 1 
438.242(b)(3) Health Information Systems: Basic Elements al 
Number Met 4 
Number Partially Met 7 
Number Not Met 0 
Rate Met 


Note: Regulation 438.240(e) refers to program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
processand isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable tot the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Grievance Systems 

Information regarding a member’sgrievance is recorded and forward to the 
Grievance Department in Tampa, Florida. Member Service staff relate the 
information contained in the Member Handbook to the member and assist as 
needed with filing a written grievance. Ifa membercalls with an issue that 
appearsto be a gnevance, but they do not wish to file a grievance, the staff 
relates that they will record the information shared, and forward it to the 
Grevance Department, with a note that the member did not request further 
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action. 


Written information from members regarding grevancesand appealsare 
received by fax, mail and e-mail. The information is logged in the health plan’s 
information system, the member is contacted to obtain clarifications and 
additional information, and an acknowledgement letter is sent to the member. If 
a provider is involved the Provider Relations office is notified. If the issue is 
actually an appeal, the information is then forward to the Appeals Department. 
Grevancesare also referred to the Corporate Service Escalation Unit, which 
works with dissatisfied customers. WellCare hasseparated their units into 
Medicaid and Medicare specialties. This unit attempts to resolve member issues 


or assist the member in understanding the outcome of the process. 


Case Management staff relate that they most often become involved isa 
member receives an adverse reply to a request for authorization. The Case 
Manager explains the member benefits, and assists the member in contacting 
the Appeals Department. The Case Managers feel that they remain involved if 
possible acting asa member advocate through both the grievance and 


appeals processes. 


The rating forthe Grievance System (5.6%) reflectsa lack of approval of the 
majority of policy and procedures required to meet MO HealthNet Managed 
Care contract requirements and federal policy. Practices observed at the time 
of the on-site review indicated that Harmony Health Plan hasa sound 
understanding regarding operation of a grievance and appealssystem. 


However, policy submission, revision and approval are not yet complete. 
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Table 65 - Subpart F: Grievance Systems Yearly Comparison (Harmony Health Plan) 


Harmony 
Federal Regulation 
| 2007 
438.402(a) Grievance and Appeals: General Requirements 1 
438.402(b)(1) Grievance System: Filing Requirements - Authority il 
438.402(b)(2) Grievance System: Filing Requirements - Timing 1 
438.402(b)(3) Grievance System: Filing Requirements - 1 
Procedures 
438.404(a) Grievance System: Notice of Action - Language and 1 
Format 
438.404(b) Notice of Action: Content il 
438.404(c) Notice of Action: Timing 1 
438.406(a) Handling of Grievances and Appeals: General 1 
Requirements 
438.406(b) Handling of Grievance and Appeals: Special 1 
Requirements for Appeals 
438.408(a) Resolution and Notification: Basic Rule 
438.408(b,c) Resolution and Notification: Grievances and Appeals 1 
- Timeframes and Extensions 
438.408(d)(e) Resolution and Notification: Grievance and Appeals 1 
- Format and Content of Notice 
438.408(f) Resolution and Notification: Grievances and Appeals - > 
Requirements for State Fair Hearings 
438.410 Expedited Resolution of Appeals 1 
438.414 Information about the Grievance System to Providers and 1 
Subcontractors 
438.416 Recordkeeping and Reporting Requirements 1 
438.420 Continuation of Benefits while Appeal/Fair Hearing Pends 1 
438.424 Effectuation of Reversed Appeal Resolutions il 
Number Met 1 
Number Partially Met 17 
Number Not Met 0 
Rate Met 5.6% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol for determining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

Harmony Health Plan isa small but emerging MO HealthNet Managed Care 
health plan operating in the Eastem Region. The staff is able to articulate their 
health plan goalsand the requirements for service delivery associated with the 
SMA contract and the federal guidelines. Through involvement in other 
Medicaid Managed Care markets, the health plan is familiar with the 
requirements in meeting all written policiesand procedures. They are struggling 
in submitting policy that is specific to this contract and that satisfies the SMA in 


meeting all requirements of writing policy and procedures. 


QUALITY OF CARE 

The Harmony staff is keenly aware of their responsibility to ensure adequate 
accessto quality healthcare ina timely manner. They realize that obtaining full 
compliance isan essential component in the compliance process. The health 
plan’s efforts and commitment to provide quality services to members was 
apparent in meeting with administrative staff, and in interviewing Member 
Servicesand Case Management staff during the on-site review. The health plan 
needs to continue to strive to meet all the SMA requirements. They voiced their 
awareness that creating an environment where all memberservices meet their 
quality standardsisan evolving process, but are able to voice their sincere 


commitment to achieving their goals. 


ACCESS TO CARE 

Harmony Health Plan has improved their provider network and continues to fully 
develop service delivery in their region. The health plan has not met policy and 
procedure requirements in this area of operation. The Member Services and 
Case Management staff express an understanding of the importance of access 
to care formembers. However, there issome disconnect noted in responses that 
reflected a lack of integration between departments within the health plan: this 
may lead to members experiencing a lesscoordinated orcollaborative 


approach to problem solving. 
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TIMELINESS OF C ARE 

Harmony Health Plan is aware of the importance of timeliness in the provision of 
health care to members. Thisisan area where complete and approved policy is 
the foundation for ensuring that members receive servicesin a timely fashion, 
have a timely response to questions, and a timely tumaround on issuessuch as 
gnevancesand appeals. Harmony Health Plan has strong goals, supported by 
health plan leadership, and communicated throughout the organization, to 

meet all of the requirements for policy development and implementation. These 
goals should allow the health plan to become fully compliant in thisarea, and 


ensure timely delivery of health care servicesto members. 


RECOMMENDATIONS 

1. Continue to develop the atmosphere within Harmony Health Plan that 
motivates the attention to compliance with contractual requirements and 
federal regulations. 

2. Develop communication that enables front line staff to have a 
coordinated and collaborative work environment that supports adequate 
information sharing. 

3. Continue to utilize the resources at Harmony Health Plan to complete all 
necessary policy documentation and submission to the SMA. 

4. Continue to enhance quality improvement initiatives intemally within the 
organization to ensure that quality servicesoccur for members. 

5. Continue to support front line staff in their efforts to be primary advocates 
for members and to provide an atmosphere based on the desire to 
provide excellent healthcare services to members. 

6. Continue to utilize available data and member infomation in orderto 
drive, change, and measure performance. 

7. Complete and submit all required policy for approval to the SMA ina 
timely manner. 


8. Continue effortsin the areas of network development and community 
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relation building. 
9. Provide oversight to the transition of behavioral health servicesto a new 
provider to ensure that members maintain provider relationships, and 


continue to receive the services required. 
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9.0 HealthCare USA 
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| oe re USA 


A Coventry Health Care Plan 


9.1 Performance Improvement Projects 


METHODS 
DOCUMENT REVIEW 
HealthCare USA supplied the following documentation for review: 


e Performance Improvement Project 2007: Appealsand Grievances 

e Performance Improvement Project 2007: Improving Post-Disc harge 
Management of Members Discharged from an Inpatient Service for 
Mental Illness 


INTERVIEWS 

Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on J uly 9, 2008 during the on-site 
review at offices in St. Louis, and included the following: 


J ackie Inglis- VP, Health Services 

Kate Darst - Director, Quality Improvement 
Debbie Fitzgerald -- Director, Health Services 
Rick Littell- VP of Operations, MHNet 

Sheryl J effries - VP Quality Improvement, MHNet 


The interviewees shared information on the validation methods, study design, 
and findings. Technical assistance regarding study design and presentation of 


findings was provided by the EQRO. The following questions were addressed: 


e Who wasthe Project Leader? 
e How wasthe topic identified? 
e How wasthe study question determined? 
e What were the findings? 
e What was the intervention? 
e What wasthe time period of the study? 
e Wasthe intervention effective? 
e What does HCUSA wantto study orleam from their PIPs? 
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The PIPs submitted for validation included a substantive amount of information. 
Additional analysis has occured between the time of the original submission of 
information and the time of the on-site review. The health plan was instructed 
that they could submit additional information following the on-site review that 
included enhanced outcomes of the intervention. Additional clarifying written 
information was received after the on-site review from HealthCare USA and 
MHNet. 


FINDINGS 

The first PIP evaluated wasconsidered non-clinical and wasentitled “Appeals 
and Grievances.” The study topic presentation explained the attempted 
literature review and the research completed in justifying the decision for topic 
selection. The narative included information from the State and local levels that 
provided support fortopic choice. The choice actually focused on improving 
systemic and policy issues relevant to both members and providers. The topic 
narrative implied a goal of ensuring that member needsare met and that 
answers are delivered to membersand providersin a timely and effective 
manner. However, the stated topic only discusses reducing the number of 
complaints, gievancesand appeals. More explicit discussion of this goal would 
improve the validity of thisnon-clinical focus and clarify the actual foundation for 


the study topic. 


The study question presented was: “Will identifying and resolving the most 
frequent reasons for. membergnrevancesand appeals; and provider 
complaints, gievances, and appeals, decrease the overall rates and result in 
improved timeliness and an overall decrease in the overtum rate?” Thisis cleanly 
a technical and non-clinical study. The study question iscomplete. Itdoes 
identify the intended resolution or outcome in terms of reducing the number of 


grievancesand appeals. It doesnot provide which parameters the health plan 
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isto meet to be successful. 


Indicators are well defined and constructed to provide measures of 
improvement. The list of indicators iscomprehensive. These indicators focuson 
all areas that measure systemic improvements and also on the specific areas 
that provide information on measuring complaints, gievancesand appeals. 
The indicatorsdo measure the number of complaints grievances and appeals, 
but also examine the reasons for them in an effort to improve services to 
members and providers. The project is designed to include all member 
grievance and appeals, and all providercomplaints, gievancesand appeals 
with no exclusions. The data collection plan outlined ensured the inclusion of all 


appropnate information. 


The data collection and analysis process is provided in specific detail. The data 
to be collected was defined in the narative. The health plan included a 
description of how information is gathered and tracked on their intemal 
grievance and appeal system. Information is provided through the Navigator 
software system and Accessdatabases. The data wascategorized according 
to the interventions. The timelinessand outcomesof each complaint, grievance, 
and appeal wasalso tracked in the Accesssystem. The health plan staff 
extracted data and the PIP included very specific definitions about the analysis 
of the data and the manner in which they intended to evaluate the data. The 
study included a systematic method for ensuring that valid and reliable data will 
be collected. Thismethodology included an explanation of capturing all 
complaints, gievances and appeals, as well asthe reason, timeliness, and 
outcome for both members and providers. CAHPS and Provider Surveys will also 
be utilized to assess the reasons the complaints, gievancesand appeals. The 
study included a detailed prospective data analysis plan. The work group 
members and their roles in performing the data analysis were described in detail. 


The processesand methodology to be used wasalso described. 
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Planned interventions were described in detail in the information provided. The 
study was initiated in 2006. The results and planned changesto enhance the 
study in 2007 were included. The data gathered forboth 2006 and 2007 was 
included. The description of the data and the analysis were not discussed ina 
manner that related it to the original data analysisplan. The analysis did identify 
the initialand repeat measurements. References to bamer analysis indicated 
that more information might be available. The information provided remained 
vague and did not specifically relate these commentsto the complaints, 
grievances, and appeals. The initial results appeared positive. Changesand 
enhancements initiated throughout 2006 and 2007 were included. These 
changes were implemented to perfect the structure of the project and improve 
outcomes. In the orginal information provided all of these changes were not 
directly related to the stated interventions, leading to some confusion in relating 
the outcomesto the orginal interventions. In updates received after the on-site 
review, additional information was provided allowing a more complete 
evaluation of the outcomes information, thereby allowing evaluators to relate 
the interventions to the reported conclusions. The support of this project, 
evidenced by the participation of a multidisciplinary team within the health plan, 
displaysa commitment to address memberand providerissues. The detail that 
can be surmised from the graphsand accompanying information does indicate 


promising results for organizational corrective action. 


The second PIP evaluated wastitled “Improving Post-Discharge Management of 
Members Discharged from an Inpatient Service for Mental Illness.” This study was 
considered clinical and focused on improving compliance with ambulatory 
follow-up appointments after discharge from inpatient mental health treatment, 
asan important factorin preventing re-hospitalizations. The project narrative 
Clearly identified how compliance with improved aftercare treatment is tied to 


accessand availability of services formembers. The decision to enact this study 
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waswell defined and supported by both local data and information and based 
ona substantial literature review that compared both national and regional 
standards. Thisreview and analysis provided a substantial argument forthe topic 
choice, and also forthe interventions identified. The approach to this 
Performance Improvement Project was not just to presenta clinical study, but to 
implement suc cessful interventions to improve servicesto members. This study 


was focused all three regions. 


The current study question presented was “Whether more adherence to 
aftercare and discharge planning to include education for families and 
members increases compliance for post-hospitalization referral visit within seven 
(7) or thirty (30) days.” The question framed the content and intention of this 
study. Indicators for this tudy were included and defined with substantive 
information about how they were to be counted and analyzed. The indicators 
did include NCQA quantifiable information. The information provided cleanly led 
the readerto understand that the focus of the study isto improve compliance 
with recommended aftercare services thereby improving outcomes regarding 
prevention of subsequent in-patient treatment. The population served by this 
study includes all three regions. It does include all members who begin this 


intervention prior to discharge from an inpatient level of care. 


The data collection methodology wasincluded. Data wasobtained quarterly 
and putin reports. These reports were then combined and analyzed ona yeany 
basis. Data sourcesand how they were to be measured and utilized in 
impacting services to members, and how they would be used to analyze project 
success were provided. A complete prospective data analysis plan wasnot 
specifically included. The information providing the history of this quality initiative 
and updates that led to the current study wasavailable and the aspectsofa 
prospective plan were woven throughout the documentation. Adequate 


information was available to ensure that data analysis planning occured. A 


Gea Performance Management Solutions Group 460 
oe A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 9 
Report of Findings - 2007 HealthCare USA 
stand alone prospective data analysis plan wasmentioned. The information 


provided ensured that consistent and accurate data collection would occur. 


An analysis of the findings was included from the 2003 baseline information and 
the 2004-2007 re-measurement data. All interventionsand new procedures, 
specific to the 2007 project were supplied in detail. Bamiers and other issues were 
identified. The current project did analyze the data within the confines of the 
study design. Repeated measurements and comparisons were presented. It 
doesappear that improvements that are identified are the results of the planned 
interventions. The outcomes were discussed in detail in the Qualitative Analysis 
section of each measure reviewed by interventions. This narrative provided 
some history of what type of interventions lacked success, leading to the current 
interventions, which did show quantitative success. Arguments were presented 
that the changesimplemented asthe result of this project created or sustained 
the improvements noted. It does appear that this project hashad a significant 
positive impact on member behavior. The outcomes presented, which identify 
the importance of the case management process in understanding member 
behaviorand banmiers, thus allowing improved interventions, such as in-home 


therapy, directly led to statistically significant project success. 


At the time of the on-site review additional information and clarification were 
made available. Allinformation presented was well documented, labeled and 
explained. The data does indicate realimprovement. Overtime the outcomes 
of this PIP indicate that the interventions did increase the use of follow-up 
servicesin both 7 and 30 days. The utilization of these servicesdecreased the 
need for in-patient treatment. The results also indicate that services available to 
members also improved. Case management services assisted in ensuring that 
members were aware of available services and had the supports needed to 


utilize these services. 
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CONCLUSIONS 


QUALITY OF CARE 

Both PIPs seek to improve the quality of servicesto members. The non-clinical PIP 
seeksto improve the issuesthe lead to complaints, gievancesand appeals for 
membersand providers. In terms of intemal proceduresand practices this PIP 
could have the effect of improving services that will decrease the incidence of 
complaints, gnevances, and appeals. If the health plan engagesin appropriate 
follow-up it will identify members who remain in need of health care services, or 
willbe able to provide a more adequate explanation of the denial of services. 
The interventions described in the clinical PIP are clearly targeted to improve the 
quality and effectiveness of aftercare services for members receiving inpatient 
mental health treatment. By assisting membersin accessing outpatient 
treatment services, and thereby avoiding the need for repeat inpatient 
treatment, the MO HealthNet Managed Care health plan will ensure that both 


preventive servicesand the most effective services will be in place. 


ACCESS TO CARE 

The clinical PIP had a specific focuson accessto care. The study sought to 
ensure that members who had received in-patient treatment for mental health 
related issues were aware of the need to begin and continue to access 
outpatient treatment services. By undertaking the methodology involved in the 
Performance Improvement Project the access to outpatient care improved, as 
did the members who appropnately utilized these services. The non-clinical PIP 
also included the theory of improving services in an effort to reduce the numbers 
of gnevancesand appeals. The narrative did make the case to ensuring that 
this goal was addressed through the PIP process. The goalsand their relationship 
to the problems addressed were included in the narative included. The PIPsand 


the supporting documentation indicating how theses projects would improve 
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accessto services were evident throughout the project. 
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TIMELINESS OF C ARE 

The servicesand interventions used in the clinical PIP did have the specific 
outcome of improving the timeliness of appropriate outpatient services for any 
member who had received in-patient mental health services. In this PIP the 
areas of access, quality, and timeliness of care were of the utmost importance. 
The outcome was focused on improving the availability of servicesat seven and 
thirty days following inpatient services. Timely accessto care wasa main focus 
of this project and the interventions utilized had the effect of improving the 
number of members who attended outpatient treatment in the required 
timeframes. The non-clinical PIP considered timeliness in looking at the resolution 
of the grievance and appeal processes. The namative provided discussed how 
these new and improved processes would improve timely services to members 
asthe result of the PIP interventions. It should be noted that timely access to 


Care waSa Stated and implied goal of both projects. 


RECOMMENDATIONS 

1. HealthCare USA has attempted to improve the timeliness, quality, and 
access to care formembers requiring health care servicesin the process 
of each of these Performance Improvement Projects. The non-clinical 
project information provided a stated goal that wasspecific and 
articulated as improving servicesand benefits to members. The non- 
Clinical PIP did include a prospective data analysis plan in the project 
planning documentation submitted after the time of the on- site review. 
The format of all PIPSshould contain complete narrative information on all 
aspects of the project to ensure that the project is understandable and 


complete. 


2. The health plan should explicitly address how their projects are extended 
to and pertinent to all the Regionsserved. In making the improvements 


experienced in the Easttem Region available to the Central and Westem 
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Regions some alterations may be required to replicate the effectiveness 


of the interventions. 


3. The health plan indicated that the processes described in both PiPsare to 
be incorporated in the regularagency processes. Thisisan important 
aspect of the PIP processand should occurto ensure that improvements 


continue on a sustained basis. 


9.2 Validation of Performance Measures 


METHODS 

This section describes the documents, data, and persons interviewed forthe 
Validating Performance Measures Protocol for HealthC are USA. HealthCare USA 
submitted the requested documents on J anuary 28, 2008. The EQRO reviewed 
documentation between J anuary 28, 2008 and J uly 1, 2008. On-site review time 
wasused to conduct follow-up questions and provide feedback and 


recommendations regarding the performance measure rate calculation. 


DOCUMENT REVIEW 
The following are the documents reviewed by the EQRO: 
e The HealthCare USA Baseline Assessment Tool (BAT) for the HEDIS 2007 
data reporting year 
e HealthcareData.com LLC’s Compliance Audit Report for HEDIS 2007 
e HealthCare USA’s information systems policiesand procedures with 
regard to calculation of HEDIS 2007 rates 
e HealthCare USA meeting minutes on information system (IS) policies 
e Asample of Catalyst’s production logsand run controls 
e National Council on Quality Assurance (NCQA)-certified HEDIS software 
certification report from Catalyst Technologies 
e Data field definitions & claims file requirements of the Coventry Corporate 
Data Warehouse 
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e Data files from the Coventry Corporate Data Warehouse containing the 
eligible population, numerators and denominators for each of the three 
measures. 

e HEDIS 2007 Data Submission Tool 

e HEDIS 2007 product work plan 
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The following are the data files submitted by HealthCare USA forreview by the 
EQRO: 

e DenominatorData_ADV.txt 

e EnrollmentData_ADV.txt 

e Denominatorata_AWC.bt 

e EnrollmentData_AWC.txt 

e DenominatorData_FUH.tt 

e =EnrollmentData_FUH.txt 


INTERVIEWS 

The EQRO conducted on-site interviews at HealthCare USA in St. Louison 
Wednesday, J uly 9, 2008 with Kate Darst, Quality Managerand Laura Fraser, Q.I. 
Coordinator. Also available by phone were Rena David-Clayton and Geoff 
Welsh, who represented the software vendor Catalyst Technologies. This group 
wasresponsible for calculating the HEDIS 2007 performance measures. The 
objective of the visit was to verify the methodsand processes behind the 


calculation of the three HEDIS 2007 performance measures. 


FINDINGS 

HealthCare USA calculated all three of the HEDIS 2007 measure being reviewed 
using the Administrative method. MO HealthNet Managed Care health plan to 
MO HealthNet Managed Care health plan comparisons of the rates of Annual 
Dental Visit, Adolescent Well-Care Visits, and Follow-Up After Hospitalization 
measures were conducted using two-tailed ztests. For comparisons that were 
statistic ally significant at the 95% confidence interval (Cl), the z-score (z), the 
upperand lower confidence intervals (Cl), and the significance levels (p <.05) 


are reported. 
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The reported Adolescent Well-Care Visit rate was 36.37%; this is comparable to 
the statewide rate forall MO HealthNet Managed Care health plans (34.81% z = 
-0.33, 95% Cl: 28.89%, 40.74%; n.s.). This reported rate is lower than the rate 
(39.31%) reported by the health plan during the 2004 EQR review. 
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The Follow-Up After Hospitalization for Mental Illness measure is reported in both 7 
day follow-up and 30 day follow-up rates. HealthCare USA reported a 7 day rate 
of 27.35%, which is significantly lower than the statewide rate forall MO 
HealthNet Managed Care health plans (35.52%; z =-0.34, 95% Cl: 22.96%, 48.08%; 
p <.05). This 7 day rate islower than the rate (29.04%) reported by the health 
plan during the 2006 report. The 30 day rate of 50.58% reported by HealthCare 
USA wascomparable to the statewide rate forall MO HealthNet Managed Care 
health plans (60.06%; z =1.38, 95% Cl: 47.50%, 72.62%; n.s.). However, this rate is 
also lower than the rate (51.03%) reported by the health plan during the 2006 
report. 


The combined rate forthe HEDIS 2007 Annual Dental Visit measure reported by 
HealthCare USA to the SMA and the State Public Health Agency (SPHA) was 
32.23%. Thiswascomparable to the statewide rate forall MO HealthNet 
Managed Care health plans (32.50%, z = 0.04; 95% Cl: 29.30%, 35.69% n.s.). This 
rate ishigher than the rate (29.04%) reported by the health plan during the 2005 
report. 


The following sections summanze the findings of the processfor validating each 
of the performance measures in accordance with the Validating Performance 
Measures Protocol. The findingsfrom all review activities are presented 
according to the EQRO validation activity, with the findings foreach measure 
discussed within the activitiesasappropnate. Please referto the tablesin the 
main report for activities, ratings, and comments related to the CMS Protocol 


Attachments. 


DATA INTEGRATION AND CONTROL 
The information systems management policiesand procedures for rate 


calculation were evaluated consistent with the Validating Performance 
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Measures Protocol. Thisincluded both manual and automatic processes of 
information collection, storing, analyzing and reporting. For all three measures, 
HealthC are USA was found to meet all the criteria for producing complete and 
accurate data (see Attachment V: Data Integration and Control Findings). 
There were no biases or erors found in the manner in which HealthCare USA 
transferred data into the repository used forcalculating the HEDIS 2007 measures. 
HealthCare USA used an NCQA-certified software vendor, Catalyst, for the HEDIS 
2007 measure calculation process. 

DOCUMENTATION OF DATA AND PROCESSES 

Although Healthcare USA usesa proprietary software package to calculate 
HEDIS measure rates, adequate documentation of this software and its processes 
wasprovided to the EQRO forreview. The data and processes used forthe 
calculation of measures were adequate (see Attachment VII: Data and 
Processes Used to Calculate and Report Performance Measures). HealthCare 


USA met all crtena that applied forall three measures. 


PROCESSES USED TO PRODUCE DENOMINATORS 

HealthCare USA met all criteria forthe processesemployed to produce the 
denominators of the performance measures validated (see Attachment X: 
Denominator Validation Findings). This involves the selection of eligible members 
forthe services being measured. Denominatorss in the final data files were 
consistent with those reported on the DST forthe three measures validated. All 


members were unique and the dates of birth ranges were valid. 


A total of 33,762 eligible members were reported forthe Adolescent Well-Care 
Visits measure. 
A total of 775 eligible members were reported forthe denominator of the Follow- 


Up After Hospitalization measure. 
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There were 88,406 eligible members reported and validated forthe denominator 


of the Annual Dental Visit measure. 


PROC ESSES USED TO PRODUCE NUMERATORS 

All three measures were calculated using the Administrative Method. Measures 
included the appropnate data ranges forthe qualifying events (e.g., well-child 
visits, follow-up visits, or dental visits) as specified by the HEDIS 2007 Technical 
Specifications (see Attachment Xill: Numerator Validation Findings). No medical 


record reviews were conducted or validated. 


For the HEDIS 2007 Adolescent Well-Care Visits measure, there were a total of 
12,279 administrative hits reported and 12,382 hits found. This resulted ina 
validated rate of 36.67% with a reported rate of 36.37%, this is an underestimate 
of 0.31%. 
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The number of administrative hits reported for the HEDIS 2007 Follow-Up After 
Hospitalization for Mental Illness measure (7 day rate) was 212; the EQRO found 
210. This resulted in a reported rate of 27.35%and a validated rate of 27.10% an 
overestimate of 0.26% The EQRO verified 389 of 392 hits for the 30 day rate, 
resulting ina reported rate of 50.58%and a validated rate of 50.19%. Thisisa 


0.39% overestimate by the health plan for this measure. 


HealthCare USA reported a total of 28,493 administrative hits for the Annual 
Dental Visit measure; 28,447 of these hits were validated by the EQRO. This 
resulted in a reported rate of 32.23%and a validated rate of 32.18%, an 


overestimate of 0.05%. 


SAMPLING PROCEDURES FOR HYBRID METHODS 

No medical record reviews were conducted orvalidated. CMS Protocol 
Attachment XIl; Impact of Medical Record Review Findingsand Attachment XV: 
Sampling Validation Findingsdo not apply to the Administrative Method. 


SUBMISSION OF MEASURES TO THE STATE 

HealthCare USA submitted the DSTforeach of the three measures to the SPHA 
(the Missourn Department of Health and Senior Services) in accordance with the 
Code of State Regulations (19 CSR §10-5.010 Monitoring Health Maintenance 
Organizations) and the SMA Quality Improvement Strategy. 


DETERMINATION OF VALIDATION FINDINGS AND CALCULATION OF BIAS 
As previously noted, the health plan overestimated both the Follow-Up After 
Hospitalization for Mental Illness and Annual Dental Visit measures. The 


Adolescent Well-C are Visits measure was underestimated. 
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Table 66 - Estimate of Bias in Reporting of HCUSA HEDIS 2007 Measures 





Direction of 
Estimate of Bias | Estimate 
Adolescent Well-Care Visits Underestimate 


Follow- Up After Hospitalization (7 days) Overestimate 
Follow-Up After Hospitalization (30 days) Overestimate 
Annual Dental Visit Overestimate 


FINAL AupIT RATING 

The Final Audit Rating foreach of the performance measures was based on the 
findings from all data sources that were summanzed in the Final Performance 
Measure Validation Worksheet foreach measure. The rates forthe Follow-Up 
After Hospitalization for Mental Illness and Annual Dental Visit measures were 
overestimated, and the Adolescent Well-Care Visits measure was 
underestimated, but all fell within the confidence intervals reported by the 


health plan. 


Table 67 - Final Audit Rating for HCUSA Performance Measures 





Final Audit Rating 
Adolescent Well-Care Visits Sub sta ntia lly Compliant 
Follow- Up After Hospitalization (7 days) Sub sta ntia lly Compliant 
Follow-Up After Hospitalization (30 days) Substantially Compliant 
Annual Dental Visit Substantially Compliant 





Note: Fully Compliant =Measure was fully compliant with State specifications; Substantially 
Compliant =Measure was substantially compliant with State specifications and had only minor 
deviations that did not significantly biasthe reported rate; A significant biasin the rate was defined 
asa numbercalculated by the EQRO that fell outside the 95% confidence interval of the rate 
reported by the health plan. Not Valid =Measure deviated from State specifications such that the 
reported rate wassignificantly biased. Thisdesignation is also assigned to measures for which no 
rate wasreported; Not Applicable =No MO HealthNet Managed Care Members qualified forthe 
measure. 
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CONCLUSIONS 

All but one of the four of the health plan’s performance measure reported rates 
were consistent with the average forall MO HealthNet Managed Care health 


plans; the remaining rate was lower than the average. 


QUALITY OF CARE 

HealthCare USA’s calculation of the HEDIS 2007 Follow-Up After Hospitalization for 
Mental Illness measure was substantially complaint with specifications. This 
measure iscategorized asan Effectiveness of Care measure and isdesigned to 
measure the effectiveness quality of care delivered. HCUSA’s 30-day rate for this 
measure wasconsistent with the average forall MO HealthNet Managed Care 
health plans; the 7-day rate wassignificantly lowerthan the average rate. Both 
of these rates were also lower than the rates reported by the health plan during 
the 2006 report. However, HCUSA’s membersare receiving the quality of care 
for this measure consistent with the care delivered to all other MO HealthNet 
Managed Care members within the 30-day timeframe, but are receiving a lower 


quality of care in the 7-day timeframe. 


The EQRO wasable to validate this rate within the reported 95% confidence 


interval and thereby hasconfidence in the calculated rate. 


ACCESS TO CARE 

The Annual Dental Visit measure was substantially complaint with spec ific ations; 
this measure iscategonzed asan Effectiveness of Care measure. Because only 
One vist is required fora positive “hit”, this measure effectively demonstrates the 
level of accessto care that membersare receiving. Healthcare USA’srate for 
this measure was consistent with the average forall MO HealthNet Managed 
Care health plans. This rate was higher than the rate reported by the health plan 
during the 2005 report, thereby showing that HCUSA members are receiving 
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more dental servicesthan during the 2005 HEDIS reporting year. HCUSA’s 
membersare receiving the quality of care forthis measure consistent with the 
care delivered to allother MO HealthNet Managed Care members. 
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The EQRO wasable to validate this rate within the reported 95% confidence 


interval and thereby hasconfidence in the calculated rate. 


TIMELINESS OF C ARE 

The health plan’s calculation of the HEDIS 2007 Adolescent Well-Care Visits 
measure was substantially compliant. This measure iscategorzed asa Use of 
Services measure and isdesgned to measure access to and timeliness of the 
care defined. The health plan’s reported rate for this measure wasconsistent 
with the average forall MO HealthNet Managed Care health plans, howeverthe 
rate reported wasless than the rate reported forthe same measure during the 
2004 report. HCUSA’s membersare receiving the timeliness of care for this 
measure consistent with the care delivered to all other MO HealthNet Managed 


Care members. 


The EQRO wasable to validate this rate within the reported 95% confidence 


intervals and thereby has confidence in the calculated rate. 


RECOMMENDATIONS 

1. The health plan’s 7-day rate for Follow-up After Hospitalization for Mental 
Illness was significantly lower than the average rate forall MO HealthNet 
Managed Care health plans. This rate wasalso lower than the rate 
reported by the health plan in 2005. The EQRO recommends the health 
plan concentrate efforts to improve this rate. 

2. The health plan should considerthe use of medical record review (when 
allowed by HEDIS specifications) asa way to improve reported rates. 

3. Work to increase rates forall measures; although most measures were 
consistent with the average forall MO HealthNet Managed Care health 


plans, they were well below the National Medicaid averagesand most 
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were lower than the rates reported by the health plan during prorEQR 


years. 
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9,3 Validation of Encounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical Fields? 


Forthe Medical claim type, there were 567,007 encounter claims paid by the 

SMA forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete and 
accurate, and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete and 
accurate, and valid. 

5. The Outpatient Units of Service field was 100.00% complete, accurate and 
valid. 

6. The Outpatient Procedure Code field was 100.00% complete and accurate, 


and 99.99% valid. The following are the three invalid entries found: 


# of 
Code times 
99261 4 
99262 1 





7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 
8. The first Diagnosis Code field was 100.0% complete, accurate valid. 
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9. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, 
fourth, and fifth Diagnosis Code fields fell well below the 100.00% threshold set 
by the SMA forcompleteness, accuracy and validity. The Diagnosis Code 
fields were 15.06%, 6.76%, 5.99%, and 0.00% complete, accurate and valid 
respectively. All the remaining fields were blank (incomplete, inaccurate, 
and invalid). 
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Forthe Dental claim type, there were 73,646 encounterclaims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. All fields examined were 


100.00% complete, accurate and valid. 


Forthe Home Health claim type, there were four (4) encounter claims paid by 
the SMA forthe period J uly 1, 2007 through September 1, 2007. All fields 
examined were 100.00% complete, accurate and valid. 


For the Inpatient claim type, there were 64,598 encounter claims paid by the 
SMA forthe period J uly 1, 2007 through September 1, 2007. 

1. The Inpatient Claim Type field was 100.00% complete, accurate and valid. 
2. The Recipient ID field was 100.00% complete, accurate and valid. 

3. The Admission Type field was 100.00% complete, accurate and valid. 

4. The Admission Date field was 100.00% complete and accurate, and valid. 
The Discharge Date field was 100.00% complete with the comect number of 
characters (size). The correct type of information (date format) was present 
98.28% (with 1,109 entries of “99999999”); thereby the Discharge Date field 
was 98.28% accurate and valid. 

The Bill Type field was 100.00% complete, accurate and valid. 

The Patient Status field was 100.00% complete and accurate, and valid. 


The first Diagnosis Code field was 100.0% complete, accurate and valid. 


oe NO Ww 


Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, 
fourth, and fifth Diagnosis Code fields fell below the 100% threshold for 
completeness, accuracy, and validity established by the SMA (99.99%, 
99.98%, 90.40%, and 73.38%, respectively). 

9. The First Date of Service field was 100.00% complete and accurate, and valid. 
10. The Last Date of Service field was 100.00% complete and accurate, and 
valid. 


11. The Revenue Code field was 99.92% complete, accurate, and valid. There 
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were 49 invalid blank fields. 


12. The Units of Service field was 100.00% complete, accurate and valid. 
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Forthe Outpatient Hospital claim type, there were 244,711 encounter claims 
paid by the SMA forthe period J uly1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Recipient ID field was 100.00% complete, accurate and valid. 

3. The First Date of Service field was 100.00% complete, accurate and valid. 

4. The Last Date of Service field was 100.00%complete, accurate and valid. 

5. The Units of Service field was 100.00% complete, accurate and valid. 

6. The Outpatient Procedure Code field was 100.00% complete, accurate, and 
39.29% valid. There were 148,572 invalid entries of “00000”, 263 invalid entries 
of “00915”, 1 entry of “00901”, and 2 entries of “00913”. 

7. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

8. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, 
fourth, and fifth Diagnosis Code fields fell below the 100% threshold for 
completeness, accuracy, and validity established by the SMA (99.99%, 
99.99%, 53.0%, and 26.09%, respectively). 


Forthe Pharmacy claim type, there were 285,221 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. All fields examined were 


100.00% complete, accurate and valid. 


What Types of Enc ounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for HealthC are USA, an eror 
analysis of the invalid entries wasconducted for fields which were lower than the 
100.00% threshold specified by the SMA. There were very few emors encountered 
in the critical fields examined acrossallclaim types. The Inpatient claim type 
contained invalid data in the Discharge Date fields. The Revenue Code field 


contained blank entries. For the Outpatient Hospital claim type, the Outpatient 
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Procedure Code fields contained invalid entries. 
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Whatis the Level of Volume and Consistenc y of Servic es? 

When companing the rate of encounter claim types per 1,000 members, the rate 
of Medical Encounter claims was significantly higher than the average forall MO 
HealthNet Managed Care health plans. All other encounter claim types were 
consistent with the average forall MO HealthNet Managed Care health plans. 
This suggests average rates of encounter data submission and good accessto 
preventive and acute care. Thiscould also be a function of the fact that HCUSA 
hasthe greatest number of encounter claims processed forall plans and thereby 


the outliers (if there are any) are not as prominent. 


To What Extent do the Claims in the State Encounter Claims Database Reflect the 
Information Doc umented in the Medical Record? Whatis the Fault/ Match Rate 
between State Encounter Claims and Medical Records? 


To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each MO HealthNet Managed 
Care health plan were randomly selected from all claim types for the period of 
J uly 1, 2007 through September 30, 2007 for medical record review. 


Of the 1,235,187 encounter claim types in the SMA extract file for) uly 1, 2007 
through September 30, 2007, 100 encounters were randomly selected. Providers 
were requested to submit medical records for review. There were 93 medical 
records (93%) submitted for review. Encounters for which no documentation was 
submitted were unable to be validated. The match rate for procedures was 
52.0%, with a fault rate of 48.0%. The match rate for diagnoses was 39.0%, with a 
fault rate of 61.0% 


What Types of Errors Were Noted? 
An enor analysis of the errors found on the medical record review for procedure, 


diagnosis, name of drug dispensed, and quantity of drug dispensed was 
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conducted. Forthe diagnosis code in the medical record, the reasons for 
diagnosis codes not matching the SMA extract file were missing information (n = 


54) and incorect (n=/). 
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Forthe procedure code in the medical record, the reasons for procedure codes 
in the SMA extract file not being supported by documentation in the medical 
record were missing information (n =39), incorect (n=8) and upcoded (n=1). 
Examples of missing information included no code; codeslisted that were not 


supported, or codesthat did not match the procedure description. 


To what extent do the MO HealthNet MC HP paid/ unpaid enc ounter claims match 
the SMA paid database? 


Since HealthCare USA included intemal control numbers that matched those of 
the SMA, the planned analysis of comparing MO HealthNet Managed Care 
health plan encounter data to the SMA encounter claim extract file was 
performed. The SMA defined “unpaid claims’ asthose claims that the health 
plan denied for payment, unpaid claimsdo not include claims paid via a 


Capitation plan. 


Forthe Phamacy Claim type, all encounterdata submitted to the EQRO wasof 
“paid” status. Forthe Dental Claim type, all encounterdata submitted to the 
EQRO wasof “paid” status. Forboth claim types, there were no unmatched 
claims that were in the HCUSA encounter file and absent from the SMA data. 
Thus, 100.00% of the HCUSA submitted encounters matched with the SMA 


encounter records. 


Forthe Outpatient Medical Claim Type (n=567,007), 41 “denied” claims were 
submitted by HCUSA but all other encounter claims were of “paid” status. For 
the Outpatient Hospital Claim Type (n =244,711), 13 “denied” claims were 
submitted by HCUSA but all other encounter claims were of “paid” status. Of the 
encounter claims submitted by HCUSA, 54 records were unmatched with the 
SMA encounter data. There wasa “hit” rate of 99.99% between HC USA 


encounter claims and the SMA encounter data. 
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For the Inpatient Claim Type, HCUSA submitted 64,598 encounterclaims. Only 32 
of these encounterclaims were of “denied” status; all other claims were of 
“paid” status. There were 00 unmatched records between HCUSA and the SMA, 
yielding a 99.99% “hit” rate. 


Why are there unmatched claims between the MO HealthNet Managed Care 
health plan and SMA data files? 


Forall claim types, the unmatched encounters were missing ICN numbers which 
are required to match the encounter to that of the SMA. Therefore, there were 


no documented “missing” claims from the SMA database. 


What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 


While the MO HealthNet Managed Care health plan did submit the data in the 
requested format (including most ICN numbers), there are a numberof ways to 
improve the data quality by improving the database system. Asthe Intemal 
Control Numberis only assigned by the State database when a claim is paid, it is 
diffic ult to match the MO HealthNet Managed Care health plan data of 
“unpaid” and “denied” claimsto the SMA data. Asthe Intemal Control Number 
is unique only to the encounter, the ICN may be represented in multiple lines of 
data. To match the MO HealthNet Managed Care health plan data to the SMA 
data to specific fields, this requires a unique line number. Therefore each service 


provided within an encounter would have a separate line of data with a unique 


line identifier. 
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CONCLUSIONS 

STRENGTHS 

1. Allencounterdata was submitted in the specified format and included 
intemal control numbers (IC Ns) which allowed the EQRO to conduct planned 
comparisons of the MO HealthNet Managed Care health plan and SMA data 
files. 

2. The critical field validation of all six claim types resulted in few fields under the 
SMA established threshold of 100.00% accuracy, completeness, and validity. 

3. The critical fieldsexamined forthe Dental and Pharmacy claim types were 


100.00% complete, accurate and valid. 


AREAS FOR IMPROVEMENT 

1. Forthe Medical claim type, there were invalid entries forthe Procedure Code 
fields. 

2. Forthe Inpatient claim type, there were invalid entries forthe Discharge Date 
fields. 

3. Forthe Outpatient Hospital claim type, there were invalid data in the 
Outpatient Procedure Code field. 

4. The health plan had a significantly lower rate of Encounter Data Diagnosis 
Validation than all MO HealthNet Managed Care health plans. 


RECOMMENDATIONS 

1. Examine and revise asneeded intemal system edits for invalid procedure 
codes in the NSF/CMS 1500 file layout forthe Outpatient Procedure Code 
and run validity checks after the programming of new edits. 

2. Ensure that Admission Date, Discharge Date, and Diagnosis fields are 
complete and valid forthe Inpatient (UB-92) claim types, and institute enor 
checks to identify invalid data. 
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9.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Priorto the site visit, documentation was received and reviewed regarding the 
MO HealthNet Managed Care health plan compliance with the State contract. 
The Extemal Quality Review Organization (EQRO) reviewed contract documents 
with the staff of the MO HealthNet Divison (MHD). On-site review time was used 
to conduct interviews with those who oversee the daily practices of the health 
plan. This ensures that documentation isdeveloped and practices occur within 
the scope of the contract and ina manner that meets or exceeds federal 


regulations. 


A detailed protocol (BHC MO HealthNet Managed Care Health Plan 
Compliance Review Scoring Form) wasutilized to ensure that all the elements of 
the federal regulations were addressed in the review process. Additionally, an 
interview tool was constructed to validate practices that occurat the health 
plan and to follow-up on questions raised from the document review and from 
the 2006 Extemal Quality Review. Document reviews occured on-site to 
validate that practicesand procedures were in place to guide organizational 


performance. 


On-site review time wasused to conduct interviews with Member Services’ Sta ff 
and Supervisors and separately with Case Management Staff and Supervisors. 
This approach wasutilized to validate the practicesoccuning when serving 
members. These interactionsand responses were compared to policy 
requirements to ensure that both are within the scope of the contractand are 


conducted in a manner that meets or exceeds federal regulations. 
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A detailed interview tool, individualized for Member Services’ Staff and for Case 
Management staff, was utilized to ensure that all pertinent elements of the 
federal regulations were addressed in the interview process. Additionally, an 
interview tool wasconstructed foradministrative staff to validate and clarify 


these practices and to follow-up on questions raised from the interviews. 


DOCUMENT REVIEW 
The Division of Medical Services supplied: 
e State of Missouri Contract Compliance Tool (including DMHN responses 


and comments) 


The following documents were requested for on-site review: 

e Member Handbook 

e Provider Handbook 

e 2007 Marketing Plan and Materials 

e Policy Tracking Log 

e Grievance Logs (Membersand Providers) 

e 2007 Annual Quality Improvement Program Evaluation 

e Care Management: Case Management, Complex Case Management, 
and Disease Management Policy 

e Algorithms forCase Management, Disease Management, and Pregnancy 
Case Management 

e Lead Case Management Policy 

e Assessment of Members with Special Health Care Needs policy 


e Case Management/Concurent Review Policy 


Additional documentation made available by HealthCare USA included: 
e HCUSA of Missouri Organizational Chart 
e Beary Important Bundle HCUSA’s Guide for High Risk Pregnancy 
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e Beary Important Bundle HCUSA’s Guide for Pregnancy 
e Mental Health Network, Inc - 2007 Quality Improvement Work Plan 
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INTERVIEWS 


Interviews were conducted with the following groups: 


Plan Administration 
e Jackie Inglis, VP Health Services 
e Nancy Marshall, MD, Medical Director 
e Carn Bynum, DO, Medical Director 
e Kate Darst, Director of Quality Improvement 
e Resmijacob-Schrieber, Director of Provider Relations 
e Gene Poisson, Director of Network Development 


e Deb Fitzgerald, Director of Health Services 


Member Services Sta ff 
e Claudia Huffman, Compliance 
e Paula DiSabatina, Manager, Member Services 
e Tina Dabler, Member Services Sta ff 


e Theresa Campbell - Member Services Staff 


Case Management Sta ff 
e Sharon McDonald, RN 
e Tasha Sharp, RN 
e Stephanie Wise, RN 
e Deidre Gyebi, RN 
e Valerie Waller, RN 
e Janet Wilson, RN 





Mandy Kennedy, Social Worker 


Grievance and Appeals Unit 





e Maureen Kaelin, Compliance Analyst 


e Bonnie Kirchhoff, Compliance Analyst 
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e Jennifer Clark, Compliance Analyst 
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FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

A strong commitment to member rights continues to be a comerstone of 
HealthCare USA’s service philosophy. The emphasis placed on continuous 
quality improvement by the health plan was apparent in both the 
documentation reviewed and throughout staff interviews. Quality services to 
members, with a particular emphasis on families and children, were observed 
within the organization. HealthCare USA views cultural diversity as an essential 
component of their interactions with members. The health plan maintains 
cultural diversity asa comerstone of initial and ongoing staff training. 

HealthCare USA employed staff that speak different languagesand are able to 
provide written materials in languages other than English. Maintaining the ability 
to serve a Culturally diverse population with a variety of special service needsis 
exhibited in the health plan’sapproach to their work and to their interactions 


with members. 


HealthCare USA has expanded their ability to communicate with visually and 
reading impaired members by contracting to produce their member handbook 
and other materials in Braille and on CD. They have information translated into 


other languagesas well. 


The health plan hascontinued efforts to impact members experiencing high risk 
pregnancies orwith a history of premature birth. HealthCare USA reports that 
their members are producing 850 births permonth. A percentage of these 
babiesgo to the neonatal intensive care unit (NICU), and a percentage 
experience congenital birth defects. The MCHP ismaking every attempt to 
identify women at risk by using the Global Risk Assessment scale at the onset of 
pregnancy. However, this wasnot identifying problems that some women 
experienced laterduring pregnancy. They have piloted a project whereby 


providers send in postcardsto the health plan if they identify a situation change 
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fora pregnant woman that increases her risk for problems or premature birth. 
Cardsare also requested from physicians who have a teen patient that 
becomespregnant. High risk pregnancies receive the most intensive level of 
case management. They are now beginning to do data analysis, including 
outcome and process measures, forthese members. The Medical Director 
completes “rounds” regulary with these case managers. They visit high volume 
providers and also send a special OB newsletter to providers. This is assisting the 


health plan in finding at-risk members and measuring the effectiveness of their 


interventions. 
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HealthCare USA ismaking effortsto leverage community relations in all three 
Regions. They work with the FQHCsin these regions and have developed a 
number of special projects. The health plan is working with UNC in the Westem 
Region, which is the local community partnership group, and the Spanish Center 
to ensure that they are addressing the needs that might be peculiarto the 
Kansas City population. They are working with community groupsin the Central 
Region to address issues specific to the rural population. One example is that 
HealthCare USA providers are conducting dental screens at Community based 


activities. 


Beginning in September 2007, the MCHP began to utilize students from the 
Chambernain School of Nursing and Community Health. They hope to enhance 
these individual’s case management skills, while exoanding the capacity of the 


health plan in providing expanded case management services. 


Asa follow-up on their asthma initiatives, the health plan provided information 
ona project that isoccuning in all three Regions. The health plan monitors 
member adherence to physician visits and medication. When a memberdoes 
visit their physician or pharmacy, they are asked to verify all contact information 
and future commitment to keeping appointments. After attending so many 
appointments, they receive a gift card, with information on “Kids’ Health” aimed 
at parents, teens, and younger children. Another initiative that the health plan 
started, in an effort to obtain current contact information for members, is placing 
a message on new membership cards asking that the member call the toll free 
number. Membess view this as “activating” theircard, even though the card is 
active assoon asit isissued. Not only have members receiving the message 
complied, but other health plan members have called in because they have 
seen this request on the cardsof friends orneighbors. Thishas greatly enhanced 
the health plan’s ability to have corect contact information for members ata 


minimal expense. 
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HealthCare USA wasasked about their EPSDT program asa follow-up from the 
prioryearsreview. The update provided information that membersin all three 
Regions receive reminders and post cards. The health plan staff conducts 
record reviews. Coventry, the health plan’s parent company, has developed 
reminder letters that are generated automatically to ensure that appointment 


reminders are sent to memberson a regular basis. 


The health plan has developed and is utilizing a Member Advisory Committee in 


all three Regions. 


Interviews with Member Services staff reveal that they receive a sx to eight week 
training regimen to prepare them to respond to questions and issues regarding 
the MO HealthNet Managed Care contract, fraud and abuse, member rghts 
and responsibilities, and HIPPA. The Member Services call center is located in 
Connecticut. The staff was present in St. Louis forthe on-site review. They 
reported that they have been in the area before, but leam from being in the 
area and become familiar with the neighborhoods that health plan members 
speak of during calls. The Member Services staff was astute in recognizing 
members’ needsand issues. They gave examples of the calls received and 
responses they provide. There wasa high degree of cooperation and 
collaboration with these staff members. They discussed an Enrollee Rights Audit 
that occured in early 2007, completed by mock interviews with other Customer 
Representatives. The audits revealed a need foradditional education. Member 
Services now assure that member informational matenals are current and 
distributed to membersin a timely manner. They have had training on 
understanding the members cultural perspective regarding health care needs. 
Other aspects of the enhanced training include team building, and an 


awareness of signs of fraud and abuse. 
Case Managers and the social worker in their department also exhibited a strong 
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sense of collaboration and coordination. They also discussed that this 
collaborative effort includes the MHNet case manager, with whom they 
exchange information freely. The social worker providesa linkage with 
community based agencies that can provide that will assist the members with 


services that may exceed their health care needs. 
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Case Managers receive referrals from an armay of sourcesincluding the Member 
Services staff, PCPs, specialists, members, health risk assessments, MHNet, the 
transportation staff, local and State health departments, from intemal reports, 
from the website, and hospitals. Case managers do in-depth assessments with 
members aftera receipt of a new referral. Thisincludesa disease assessment 
and a more general assessment process. This information is reviewed and 
updated with members every ninety days. All members with a special health 
care need also have a written treatment plans. These are completed in 
coordination with the member's physician. The member has access to the 


treatment plan and will receive a copy if requested. 


The case managers make special efforts to make frequent telephone contacts 
with their members. They have been trained in patient-centered interviewing. 
The health plan iscontinuing to investigate how to evolve the case 
management processto become interactive rather than reactive. The health 
plan is attempting to create an atmosphere that supports members, while 


focusing on member responsibility and independence. 


The health plan doeshave case management staff located in all Regions. They 
utilize the Health Risk Assessment received through the SMA asmuch aspossible. 
The health plan reports that community connections, particulary in the rural 
areas, and provider referrals are more effective in identifying members with 


special health care needs. 


Ratings of compliance with Enrollee Rights and Protections (100%) indicate that 
HealthCare USA made a concerted effort to improve their compliance in this 
area. The health plan completed all required policiesand these were approved 
by the SMA. Interviews with administrative, Member Services an Case 
Management staff indicated a commitment to attend to the details of 


completing required policies and maintaining this level of success, and further to 
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ensure that these policies are operationalized in interactions with health plan 
members. The health plan had a stated goal of 100% compliance with SMA 
contract requirements and federal regulations, which wasachieved forthe 


second year. 
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Table 68 - Subpart C: Enrollee Rights and Protections Yearly Comparison (HC USA) 







HealthCare USA 


20052006 | 2006 


Federal Regulation 




















438.100(a) Enrollee Rights: General Rule 2 2 2 
438.10(b) Enrollee Rights: Information Requirements 1 2 2 
438.10(c)(3) Alternative Language: Prevalent Language 2 2 2 
438.10(c)(4,5) Language and Format: Interpreter al > 2 
Services 

438.10(d)(1)(i) Information Requirements: Format/Easily 2 2 2 
Understood 

438.10(d)(1)(ii)and (2) Information Requirements: Format 2 > 2 
Visually Impaired, and Limited Reading Proficiency 

438.10(f) Information for All Enrollees: Free Choice, etc. 1 2 2 
438.10 (g) Information to Enrollees: Specifics/Physician 2 3 2 
Incentive Plans 

438.10(i) Special Rules: Liability for Payment/Cost 1 > 2 
Sharing 

438.100(b)(2) (iii) Enrollee Rights: Provider-Enrollee 2 2 2 
Communications 

438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 2 2 2 
Directives 

438.100(b)(3) Right to Services 2 2 2 
438.100(d) Compliance with Other Federal/State Laws 2 2 2 
Number Met 9 13 13 
Number Partially Met 4 0 0 
Number Not Met 0 0 0 
Rate Met 69.2% 100.0% 100.0% 














Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


BEHAVIORAL HEALTH 

Individuals from the behavioral health subcontractor, MHNet, were interviewed 
at the on-site review. The MHNet staff shared information regarding a number of 
initiatives undertaken during 2007. One project involved the support of members 
through targeted follow-up when they are discharged from inpatient treatment. 
Another measure focused on avoiding weekend discharges for members 
requiring inpatient treatment. MHNet’s goal wasto have the member ready for 


discharge priorto Saturday to avoid weekend emergencies. 
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The Behavioral Health Organization’s (BHO) system was undergoing 
enhancement to capture baseline information on members receiving behavioral 
health services. MHNet continues the practice of authorizing family therapy, in 
addition to required individual therapy, for all children underage 21 who need 
behavioral health services. The BHO believes that this additional resource will 
assist in ensuring that the family had an understanding of issues facing their child, 
that the entire family would be working together to ameliorate problems, and 
that the family would understand the child’s emotional functioning. The BHO 
works closely with HealthC are USA to identify expectant mothers to ensure that 
required behavioral health services were in place in an effort to prevent post 
partum problems. The BHO hasalso made a concerted effort to ensure that 
information and educational matenal is translated into different languages. 


Multilingual providers are available to members. 


The health plan in collaboration with MHNet has made a concerted effort to 
offer adequate case management services between the two agencies. They 
provide case management to any member requiring a hospital admission, who 
attempts suicide, during and immediately after pregnancy, who hasa history of 
non-compliance, and/or those with serious disease management issues. Case 
managers maintain regular phone contacts to ensure coordinated and 
necessary servicesand supports, such astransportation, are in place. The BHO 
relates that they are making an effort to keep primary care physicians informed. 
The feedback they have received is that the PC Psare surprised and appreciate 


these coordination efforts. 


MHNet has developed a number of othertools to support the members they 
serve. These include: a guide for parents who have children with autism; a 
program fortreatment of obesity; targeted services for children diagnosed with 
Attention Deficit Hyperactivity Disorder; and a newsletter with information for 


pregnantand post partum members. The BHO recognizes that differences exist 
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in the three Regionsand has worked with the respective Community Mental 
Health Clinics and C-STAR programs to develop strong working relationships. 
These groupsare invited to meetings every two to three months to discuss 


Curent issues, meet staff, and to develop strong organizational relationships. 
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QUALITY ASSESSMENTAND PERFORMANCE IMPROVEMENT 

Access Standards 

HealthCare USA worked with both members and providers to ensure proper 
accessto services wasavailable. They developed a large provider network 
throughout all three Regions, and continued to recruit providersto expand 
services available, particulary in the Central Missoun area. Thisenabled 
membersto have an adequate choice for both PCPsand specialty providers. 
The MCHP does authonze the use of out-of-network providers when this will best 


meeta member's healthcare needs. 


One of the health plan’s efforts during 2006 and 2007 wasto recruit dental 
providers. They have had some success, but relate that this isan ongoing 
initiative. They made an effort to work with providers who were not traditionally 
MO HealthNet Managed Care vendors. With receipt of appropriate medical 
background information, these providers have accepted health plan members. 
The dental subcontractor, Doral Dental, placed a provider representative in the 
Central Region to ensure ample recruitment occured and that a representative 
wasavailable locally to assist in problem solving when this was required. Doral 
Dental initiated a work plan to obtain additional providers. HealthCare USA 
Provider Relations worked with Doral to ensure that the subcontractor had 
assitance asneeded. Special attention was given to the issue of transportation 
while this network development continues. The health plan paid for mileage 
when a memberhad a vehicle, or another method of transportation to attend 
dental appointments, when they occured at an excessive distance. This 
assisted in increasing the availability of services. Another method utilized by the 
health plan wasnegotiating an altemative fee schedule for providers reluctant 
to participate due to reimbursement issues. HealthCare USA reported that the 


network did improve, but they continue to concentrate on development efforts. 


The health plan continues its efforts to monitor their provider network for 
accessibility and availability of both primary care physicians and specialists in all 
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three Regions. The health plan makes an effort on behalf of membersto share 
information about changesin provider availability, and to provide assistance in 
making appointments or identifying an appropnate provider if necessary. This 
activity wasreported by both the Member Services staff and the Case managers 
interviewed. The health plan isalso participating in member events, such as 
Back to School Fairs, to provide information about the availability and 
accessibility of services. In the Westem Region, the FQHC, Swope Health 
Services, is providing school physicals, dental screenings, and vision screenings 
forchildren. HIV screeningsand mammogramsare provided foradults. The 
screenings coordinated with Swope Health Servicesare available to all children, 
whether ornot they are health plan members. Ifa child isnot a HealthCare USA 
member pertinent information is forwarded to the appropriate MO HealthNet 
Managed Care health plan. Several smaller fairsand events occured in the 
Central Region. One of these events is scheduled for Boone and one in 
Callaway Counties. Additionally the health plan will be involved in 38 other 
events in the Central Region. In the Eastem Region the health plan is scheduled 
to participate with over fifty vendors in North St. Louis City and South St. Louis 
County. 


The health plan participatesin baby showers that are held at the FQHCsin all 
Regions. Babies‘R Us wasincluded in the Westem Region to provide seminars 
and informational information to parents. These occured at the Sam Rogers 


and Swope Health Services clinics. 


Member Service staff could relate examples of issue that arse regarding 
members’ accessto care. They also discussed situations when members call to 
request disenrollment. They discussed the request with members to determine if 
the member understands their health plan benefits, and to discem if they 
actually need help with a provider, orif they are having a problem with a 


provider. They relate that occasionally members call because another family 
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memberis enrolled in a different health plan, or are having a provider issue. In 
some instances, Member Services staff relates that they are able to find a 
provider who ismore acceptable to a member, orcan assist in resolving other 
issues. When thisoccurs the member sometimes rescinds their request to dis- 
enroll. In other instances they process the request and ensure that the corect 


unit receives the request and all necessary information to process the request. 


Case Managers discussed their efforts to ensure that members obtain timely and 
appropnate services. They directly contact PCPsand specialists if bamiers exist to 
obtaining appointments or other necessary services. Case Managers also 
discussed members’ rights to refuse case management services. When this 
occurs the case managers attempt to educate members on other community 
services available, and educate about how to work with their providers. The 
case managerthen sendsa post card with theirname and a message that they 


can be available again if the member has future service needs. 


Ratings of compliance with Access Standards regulations (100%) for the second 

year, and reflect the fact that all HealthCare USA policieshave been submitted, 
reviewed, and approved by the SMA. The health plan has improved in this area 
each year, and continues to strive to meet all required SMA contract 


requirements and federal regulations. 


Table 69 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (HC USA) 









HealthCare USA 


20052006 | 2006 


Federal Regulation 


438.206(b)(1)(i-v) Availability of Services: Provider Network 2 2 2 
438.206 (b) (2) Access to Well Woman Care: Direct Access 2 2 2 
438.206(b)(3) Second Opinions 2 2 2 
438.206(b)(4) Out of Network Services: Adequate and Timely 2 > > 
Coverage 

438.206(b)(5) Out of Network Services: Cost Sharing 1 2 2 
438.206(c)(1)(i-vi) Timely Access 1 2 2 
438.206(c)(2) Provider Services: Cultural Competency 2 2 2 
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438.208(b) Care Coordination: Primary Care 

438.208(c)(1) Care Coordination: Identification 

438.208(c)(2) Care Coordination: Assessment 

438.208(c)(3) Care Coordination: Treatment Plans 
438.208(c)(4) Care Coordination: Direct Access to Specialists 
438.210(b) Authorization of Services 

438.210(c) Notice of Adverse Action 

438.210(d) Timeframes for Decisions, Expedited Authorizations 


438.210(e) Compensation of Utilization Management Activities 


NIN N FP N NY NY NN N 
NIN NY NY N NN NY N N 


438.114 Emergency and Post-Stabilization Services 
Number Met 

Number Partially Met 

Number Not Met 


Hh 
N 
Hh 
N 


OOnrFN NF NN HY NEN 
ro) 
N 


0 0 


Rate Met 64.7% 100.0% 100.0% 





Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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Structures and Operation Standards 

HealthCare USA instituted a number of measuresto improve practice in this area 
in 2005 that continued during 2006 and 2007. The health plan holds quarterly 
oversight meetings with all subcontractors in each region to discuss service 
provision issues and to monitor activities. The meetings are used to monitor key 
performance indicators and to review provider panels. Annual evaluations are 
completed on each subcontractor, and daily contact is maintained. 

HealthCare USA reported this increased contact and monitoring allowed them 


to address administrative and memberissuesin a timely and effective manner. 


On-site reviews were also conducted by the health plan during 2007 to assess 
the providers’ use of practice guidelines, and to review that all required 
documentation wasin place. Thishas been effective in ensuring the quality and 


timely provision of care. 


HealthCare USA created a provider advisory group, which is currently 
functioning in the Eastem Region and isbecoming operational in all three 
Regions. The committee is made of high volume providers and representatives 
from across specialties. The sharing of ideasand information pertaining to any 
member dissatisfaction isencouraged. These groupsseek provider feedback 
and provide information in a framework that allows the health plan to develop a 


true partnership with their provider network. 


The health plan is performing credentialing audits following URAC and NCQA 
standards. The health plan policiesand procedures were reviewed and were in 
compliance with both the SMA contract requirements and the federal 


regulations. 


Member Services staff and Case Managersdo not have a lot of impact in the 


area of Structure and Operation Standards. However, they both related that 
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they do assist membersif they have provider issues orproblems. They then refer 


these issues to Provider Relations for follow-up. 


Ratings for compliance with Structure and Operation Standards (100%) reflected 


completed and approved policy and proceduresin this area forthe second 


year. 
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Table 70 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (HC USA) 











HealthCare USA 


2005 2006 


2 


Federal Regulation 













438.214(a,b) Provider Selection: Credentialing/Re- 


recredentialing 2 2 
438.214(c) and 438.12 Provider Selection: 2 2 2 
Nondiscrimination 
438.214(d) Provider Selection: Excluded Providers 2 2 2 
438.214(e) Provider Selection: State Requirements 2 2 2 
438.226 and 438.56(b)(1-3) Disenrollment: 1 

: are 2 2 
Requirements and limitations 
438.56(c) Disenrollment Requested by the Enrollee 1 2 2 
438.56(d) Disenrollment: Procedures 1 2 2 
438.56(e) Disenrollment: Timeframes 2 2 2 
438.228 Grievance System 2 2 2 
438.230(a,b) Subcontractual Relationships and 1 2 > 
Delegation 
Number Met 6 10 10 
Number Partially Met 4 0 0 
Number Not Met 0 0 0 
Rate Met 60.0% 100.0% 100.0% 











Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Measurement and Improvement 

The MO HealthNet Managed Care health plan continued to use InterQualasa 
guide for decision-making in terms of utilization review. InterQual criteria were 
Originally cited when asked about practice guidelines. The health plan has 
instituted a number of practice guidelines and has instituted a number of 
initiatives to ensure their distribution to and use by providers. HealthCare USA’s 
Medical Director does ensure that monitoring utilization of practice guidelinesis 


occuming at the provider level. 


HealthCare USA continued to have a well developed intemal written quality 
assessment and improvement program. The health plan shared their Quality 


Management Charterand minutes from meetings. The Quality Management 
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Program focused on monitoring, assessment, and evaluation of clinical and non- 
Clinical service delivery. The result hasbeen the implementation of quality 
programs that targeted members with special healthcare needs, but also 
provided enhanced servicesto all members. HealthCare USA indicated that 
they recognized the need to stratify data by region. The Quality Management 
charter ensured that meetings occurat least quarterly on a regular schedule 

and had representatives from all sections of the organization, as well asincluding 
providers. The quality management process ensured that the health plan 
maintained a record of activities, recommendations, accomplishments, and 


follow-up. 


Through the administrative method, the health plan did report data for 


Validating Performance Measures. 


The health plan did submit clinical and non-clinical Performance Improvement 
Projects. The details of the audit are located in the appropnate section of this 
report. The MCHP continued to operate a health information system that meets 
required standards. Encounterdata was submitted in the format requested so 
that appropnate validation could occur. The details of this processare located 


in the Validating Encounter Data section of this report. 


Ratings for compliance with Measurement and Improvement regulations (100%) 
reflect the completion of all policy and procedures in this area forthe second 
year. The health plan did submit all data in requested formats, allowing the 


proper validation processto occur. 
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Table 71 - Subpart D: Quality Assessment and Performance Improvement Measurementand 
Improvement Yearly Comparison (HC USA) 


HealthCare USA 


20052006 


Federal Regulation 


438.236(b)(1-4) Practice Guidelines: Adoption 2 2 2 
438.236(c) Practice Guidelines: Dissemination 1 2 2 
438.236(d) Practice Guidelines: Application 2 2 
438.240(a)(1) QAPI: General Rules 2 2 2 
438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCHP 1 > 2 
Quality Improvement and PIPs 

438.240(b)(2)(c) and 438.204(c) QAPI: Performance 1 

Measurement 

438.240(b)(3) QAPI: Basic Elements/Over and Under Utilization 

438.240(b)(4) QAPI: Basic Elements regarding Special 2 > > 
Healthcare Needs 

438.240(e) QAPI: Program Review by State NA NA NA 
438.242(a) Health Information Systems 2 2 2 
438.242(b)(1,2) Health Information Systems: Basic Elements 2 

438.242(b)(3) Health Information Systems: Basic Elements 2 2 2 
Number Met 7 11 11 
Number Partially Met 4 0 

Number Not Met 0 0 0 
Rate Met 63.6 100.0% 100.0% 


Note: Regulation 438.240(e) refers to program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
process and isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable tot the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met ; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Grievance Systems 

Rating forcompliance with Grnevance Systems regulations (100%) indicates that 
the MCHP completed all requirements regarding policy and practice in their 
gnevance system. Thisisthe fourth year that HealthCare USA has been 100% 
compliant in the area of Grievance Systems and reflects that the health plan 
considers this an important aspect of compliance in both policy and practice. 
Out-of-network providers are informed of policiesand procedures regarding 
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complaints, gievancesand appeals through the Provider Manual and Web Link. 


The health plan has resolved to obtain timely grievance resolution for both 
members and providers. The gnevancesare placed in their CSO system, which 
tracks timeframesand generates notices and letters. Specific staff is assigned to 
appeals formembers. They assist in obtaining the most complete information to 
present to an appeals committee. The member is notified by telephone and in 
writing of the decision to ensure that they have the information as quickly as 
possible. HealthCare USA utilizesan appeals form formembers and does 


provide assistance with the written request foran appeal. 


Member Services staff indicate that they receive information or contact from 
members that they immediately recognize asgrievancesand appeals. They 
listen to members, record information and referthe situation to the Grievance 
Department. The Members Services staff shared that sometimesa member does 
wish to pursue the issue aSa grievance orappeal, but they make a referral with 
a notation that the member does not wish to have theirname revealed. These 
usually concem provider issues that will need follow-up to resolve. They also 
relate that gnevancesand appeals are reviewed in quarterly meetings. There is 
a great deal of communication between departments regarding the findings 


and analysis. 


During the Member Servicesand Case Management interviews it was leamed 
that these staff are not integrally involved in the Gnevance and Appeal process. 
Asa result a short interview occured with members of the Grnevance 
Department. They reported that the health plan receives approximately sixty 
grievances per month, forty appeals per month, and 1-2% may become a State 


Fair Hearing. They estimated that 75% of callscome directly fom members. 


The Grievance Department staff gave the example of a membercalling about 
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an adverse authonzation decision. The Compliance Analyst informs the member 
on how to proceed through the appeal process. The member is made aware of 
their rights and is given assistance in moving throughout the process. Outside 
physicians are utilized forreview of the case and responsible forthe final appeal 
decision. The Compliance Analysts all reported that adverse decisions are often 
the result of a lack of complete medical information. When additional 
information is available the denial isovertumed. All decisions are recorded in the 
health plan system, and appropnate comespondence issent to members and 


providers. 
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Table 72 - Subpart F: Grievance Systems Yearly Comparison (HC USA) 
HealthCare USA 


Federal Regulation 


438.402(a) Grievance and Appeals: General Requirements 2 2 2 
438.402(b)(1) Grievance System: Filing Requirements - Authority 2 2 2 
438.402(b)(2) Grievance System: Filing Requirements - Timing 2 2 2 
438.402(b)(3) Grievance System: Filing Requirements - Procedures 2 2 2 
438.404(a) Grievance System: Notice of Action - Language and 2 > > 
Format 

438.404(b) Notice of Action: Content 2 2 2 
438.404(c) Notice of Action: Timing 2 2 2 
438.406(a) Handling of Grievances and Appeals: General > 2 
Requirements 

438.406(b) Handling of Grievance and Appeals: Special Requirements 2 2 

for Appeals 

438.408(a) Resolution and Notification: Basic Rule 

438.408(b,c) Resolution and Notification: Grievances and Appeals - 2 > > 
Timeframes and Extensions 

438.408(d)(e) Resolution and Notification: Grievance and Appeals - 2 2 2 
Format and Content of Notice 

438.408(f) Resolution and Notification: Grievances and Appeals - 2 > > 
Requirements for State Fair Hearings 

438.410 Expedited Resolution of Appeals 2 2 2 
438.414 Information about the Grievance System to Providers and > > 
Subcontractors 

438.416 Recordkeeping and Reporting Requirements 2 2 2 
438.420 Continuation of Benefits while Appeal/Fair Hearing Pends 2 2 
438.424 Effectuation of Reversed Appeal Resolutions 2 2 2 
Number Met 18 18 18 
Number Partially Met 0 1 0 
Number Not Met 0 0 0 
Rate Met 100% 100% 100% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol for determining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

HealthCare USA continued to exhibit a commitment to completing, submitting 
and gaining approval of required policy and procedures by the SMA. The health 
plan maintained improvementsto achieve 100% compliance in all sections of 
the protocol forthe second year. The operationsand practices revealed during 
interviews at the on-site review indicated a commitment by HealthCare USA to 
provide quality healthcare services to its members. Health Plan activities 
focused on: enhancing preventative services; creating new approaches to 
providing access to servicessuch asthe development of after-hours clinics; 
obtaining member input on issues; in engaging provider input into improving and 
delivering services effectively; and responding to prior authorizations and 


gnevancesin a timely and efficient manner. 


The health plan incorporated methodsto track required policy submission into 
daily administrative practice and took this process seriously. The practice 
observed at the time of the on-site review provided confidence that the health 
plan made service to members their primary focus and that there wasa 
commitment to comply with the requirements of the MO HealthNet Managed 


Care contract and federal regulations. 


Itis also noted that all staff interviewed reflected the health plan’s culture of 
respect for memberand the priority formeeting memberservice needs. Staff 
members were open and animated in their responses. They were eagerto give 
examples of how they assist members in nommal and extraordinary 


circumstances. 


QUALITY OF CARE 
The staff at HealthC are USA exhibits a commitment to excellence that creates 


an atmosphere where both members and providers expenence quality services. 
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The provider relations staff made regular contacts with providers to troubleshoot 
problemsthat may be reported by members, and to assist provider staff in 
making interactions with members and the health plan lesscomplicated. Efforts 
within the communities served, involvement with FQHCs, and with Community 
Mental Health Clinics, are examples of working to produce quality care inthe 
most convenient environment, and working to improve access to care for 
members. These relationships have also allowed education to occurthat 
improvesthe quality of services for both the member and organizational level. 
Member Services and Case Management staff related the importance placed 
on training and collaboration to ensure that they are aware of issues that may 
arise and can respond quickly and efficiently to ensure that members have 


accessto quality health care. 


ACCESS TO CARE 

HealthCare USA provided numerous examples of initiatives they are involved in 
to ensure that members have information on obtaining services and have 
adequate accessto services. Several projects bring providers directly to places 
where membersare available. The health plan hasalso undertaken provider 
recruitment and retention efforts that ensure that providers are available to 


members throughout all three Regions served. 


Intemally HealthCare USA, asan organization, has made efforts to ensure 
interdepartmental integration to create thorough knowledge of their service 
delivery system thus enabling staff to assist members effectively. Staff exhibited 
enthusiasm in describing the services they deliverand a desire to ensure that 


members’ health care needsare met in spite of the bamers sometimes 


experienced. 

TIMELINESS OF C ARE 
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The health plan wasable to complete all required policiesand proceduresina 
timely manner, to ensure compliance with State contract requirements and 
federal regulations. This effort reflects the attention needed to be able to focus 
on memberservice needs. HealthCare USA has also initiated a number of 
practicesthat enhanced timely response and resolution of gievancesand 
appeals for both membersand providers. Thisdecision making process enables 
members to obtain the healthcare they require in a timely manner. The health 


plan recognizes the importance of timely and adequate services. 
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RECOMMENDATIONS 
1. Maintain the importance of complying with documentation requirements to 


the same standards as those reflected in the daily practice within the health 
plan. 

Continue health plan development in the area of utilization of available data 
and member information to drive change and support opportunities for 
organizational growth and development. 

Continue to track policies and other materials required for annual review. 
Continue the commitment to oversight of subcontractors, such as MHNet and 
Doral Dental. Quarterly reviews ensure that member servicesare at the level 
the MCHP requires. 

Maintain involvement in community-based servicesand activities. 

Continue training efforts with front line staff to ensure that they are versed in 
health plan policy and proceduresand remain confident in their interactions 


with and advocacy formembers. 
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Mercy CarePlus 


Health tnsurance Made Easy 


10.1 Performance Improvement Projects 


METHODS 
DOCUMENT REVIEW 
Mercy CarePlus supplied documentation for review of two: 
e 2007 Emergency Room Utilization 
e 2007 Early Intervention in Prenatal Case Management and the 
Relationship to Very Low Birth Weight Babies 


INTERVIEWS 

Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on J uly 8, 2008 during the on-site 
review at the St. Louis, Missoun offices of the health plan, and included the 
following: 


Dr. Robert Profumo - Medical Director 

J ennifer Goedeke - Director - Quality Improvement 

Cherie Brown - Manager, Case management/Pre-Authonzation 
April Gross, RN - Complex Case Manager 

Diane J ellison, RN - Complex Case Manager 

Nancy Zmuda - Director, Utilization Management 


The interviewees shared information on the validation methods, study design, 
and findings. Technical assistance regarding study design and presentation of 
findings was provided by the EQRO. The following questions were addressed: 


e Who were the members of the staff involved with the project and what 
were their roles? 

e How wasthe topic identified and the choice justified ensuring that the PIP 
truly addressed an important aspect of member care and services? 
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How wasthe study question determined? 

What were the interventions? 

What was the time penod of the study and is it complete? 

What were the findings? 

Were the interventions effective? 

What does Mercy CarePlus want to study orleam from their PIPs? 

Is Mercy CarePlus utilizing the Performance Improvement Project process 
to enhance intemal procedures and to improve member services and 
healthcare? 


The PIPs presented did not orginally provide enough documentation to allow for 
a thorough validation of the findings. Additional time was provided for Mercy 
CarePlus to supply an update of both Performance Improvement Projects prior 


to final evaluation. 


FINDINGS 
The first, Emergency Room Utilization was originally evaluated in 2006. This 
project wasre-evaluated forthe 2007 Extemal Quality Review. In 2006 Mercy 
CarePlus submitted documentation for Emergency Room Utilization for Asthma- 
Related Diagnoses for 5-18 Year Olds at Cardinal Glennon Hospital as their non- 
Clinical performance improvement project. This Performance Improvement 
Project was revised forthe 2007 review year and wasresubmitted asthe non- 
Clinical PIP entitled “Emergency Room Utilization.” The second Performance 
Improvement Project submitted was Ean Intervention in Prenatal Case 
Management and the Relationship to Very Low Birth Weight Babies. This PIP was 
submitted asthe health plan’sclinical performance improvement project, which 
isalso a re-evaluation of a previously submitted project. This review includes 
information indicating whether or not the re-evaluation of these Performance 
Improvement Projects provides any trends in: 

e improvement rates forthe studies; 

e improvement in satisfaction; or 


e overall improvement in member services. 
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The original PIP, “Emergency Room Utilization (Children Receiving Emergency 
Room Services at Cardinal Glennon Hospital)” was evaluated during the 2005 
and 2006 EQR. The focus of this study remained unclear due to fundamental 
changesin the study topics. The orginal study was designed to reduce the 
incidents of emergency room visits at one St. Louis area children’s hospital. 
Beginning in October 2005, the study wasnanowed to address “Emergency 
Room Utilization for Asthma-Related diagnoses for Children 5 - 18 years at 
Cardinal Glennon Hospital.” The current study, conducted throughout 2007, 
focused on members using the emergency rooms for non-emergent medical 
visits, rather than visiting their primary care physician (PCP) oran Urgent Care 
Center (UCC). The study question forthe current topic hasbeen revised. The 
Current study questions are: 1) Do MCP members with frequent Emergency 
Department (ED) use, defined as three or more ED visits in any three-month 
period, represent persons who have increased and/orunmet medical needs 
Causing an increase in ED utilization? 2) If unmet needsare identified, can 
Complex Case Management (CCM) provide education and resources, which 
will allow these members to obtain medical care ata more appropriate setting 
and in conjunction with their Primary Care Physician (PCP) and thus, reduce ED 
utilization? 3) In members with frequent ED use who do not have unmet needs, 
can education on altemative care options (PCP, UCC, home treatment) by the 
CCM team reduce unnecessary ED visits? Thisexpanded set of questions 
createsa complex, but more in-depth approach to investigating this study topic. 
These questions provide a cleardirection to the study, and illustrate how the 
study willbe measured. The narrative does provide justification forthe choice of 
topic. The presentation uses local health plan data and information, supported 
by a literature review and other research to support the choice of this issue asa 
salient topic to improve organizational functions and servicesto a possibly fragile 
set of members. The population included any member utilizing emergency room 


services three ormore timesin any three-month period. The population did not 
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exclude any member with special needs, but conversely believed it would 
identify membersin need of complex case management who may have unmet 


specialneeds. There wasno sampling conducted. 


The revised hypothesis presented is as follows: 

e MCP Members with frequent ED use represent a subset of members with 
increased and/orunmet medical needscausing an increase in ED 
utiliza tion; 

e Complex Case Management can decrease the rate of frequent ED 
utilization via member education, removal of bamersto care, and 
increased coordination of care through the PCP; and 

e The MCP Case Management Team can offer members with frequent ED 
utilization altemativesto seeking care in the ED in orderto educate 
members that not all acute situations require a visit to the ED; many 
situations can be treated safely athome, at the PCP office oratan 


Urgent Care Center. 
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The objective of the study isto reduce the numberof emergency room visits and 
improve the use of primary care physicians or urgent care resources. The study 
narative provides information on how data on identified indicators were 
measured. The original methods proved to be inaccurate or untimely in 
identifying the membersin question. Specific clear measurable indicators and 
how information was reported is clarified in the most recent updates. Needed 
changeswere mentioned, a new reporting methodology was provided. Study 
indicators explaining how individuals, as wellasthe general MCP population 
using ED services, were tracked and approached with CCM services was 
included in the namative. The individuals involved in the study, including the 
CCM team wasdefined including team member rolesand qualifications. All 
intemal resources used in researching identified member history and services 
were utilized and defined. Health plan policy outlining the expectations for this 


level of medical management was included. 


The PIP does indicate how ED visits are tracked by member, orhow members are 
tracked to identify a recurrence of ED visits. It doesindicate how new members 
ornew ED visits are identified. The information provided identified members who 
were receiving case management services, those newly enrolled in case 
management services based on the parameters of the PIP. It provided 
clarification on how these services were used, or how they impacted the 
members’ decisions regarding the use of ED services, ratherthan primary care 


physician services orurgent care resources. 


The interventions, orcomplex case management processes include: 
e Education about the benefitsasan MCP member 
e Discussion of chronic medical/psychiatric conditions 
e Evaluation of unmet medical/psychiatric needs 
e Education and linksto community resources 


e Offerof inclusion in relevant disease management programs 
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e Education on the situations that require emergent medical care, as 
opposed to urgent and routine situations 
e Removal of bamierssuch asthe provision of transportation to a PCP or 
UCC 
e Discussion on the importance of compliance with prescribed medications 


and therapies 
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e Provision of the name and location of the nearest UCC along with an 
explanation of the appropnate reasons for using a UCC 
e Direction to the appropriate provider if the memberisin need of specialty 
Care 
e Analysis of the potential for pharmacy lock-in if the member isnoted to be 
going to multiple EDsand receiving narcotic prescriptions 
e Education about the purpose of the MCP Nurse Advice Line, asa 
resource for member use 
e Education of the importance of using a PCP asa medical home and the 
provision of the members PCPsname, address, and phone number, as 


wellasencouragement to call the PCP fora follow-up appointment 


The study did include results forthe third and fourth quarters of 2007. It appears 
from the data gathered and analyzed to date that the hypothesis and 
interventions are sound and have a high probability of having a postive impact 
on member behavior and accessto services. It is difficult to determine the 
statistical effectiveness of the interventionsto date. The study did include a 
detailed methodology for retrieving demographic and other pertinent data. The 


study explained the sources forthe data retrieved, and validated their reliability. 


The study utilized a specific study design and systematic method of collecting 
valid and reliable data. The future improvement strategies, interventions and 
analysis were described to ensure that the study would continue and have 
ongoing resultsto report. Diagramsand graphs were presented for the two 
quarters where data wasavailable. Data sourcesare defined, and assure that 
complete and accurate data willbe collected. Chartsinclude information on 
frequent ED users. How these chartsand graphsare related to the hypotheses 


and how this information relatesto anticipated outcomes is described. 


The future of planned interventions isdefined. The effect of the interventions and 
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how they will be measured isprovided. The study namative describes that if the 
planned interventions continue to have the postive impact that has been 
experienced thus far, it will create a decreased frequency of inappropnate use 
of emergency room services. The health plan describesthe environment for 
sustained improvement and the assumption that the need for complex case 
management for the same members should decrease if the effectiveness of the 


interventions continue. 


The information that was made available to the EQRO doesnot allow for in- 
depth analysis of the PIP to date. However, the information provided does 
provide confidence that this tudy hasa strong potential fora positive and 
sustained improvement in memberservicesand outcomes. The outline of the 
project should develop into a meaningful method of improving services to 
members. A detailed explanation is presented of how the data collected will be 
used, what the expected outcomesof the planned interventions are, and how 
these interventions will improve health care servicesformembers. The study has 
potential for real and sustained improvement if it continues to be conducted ina 


structured and meaningful manner. 


The second PIP evaluated wasthe Clinical submission entitled, “Early Intervention 
in Prenatal Care Management and the Relationship to Very Low Birth Weight 
Babies.” This project asked if increased ratesof obstetrical case management 
would positively affect birth outcomes. The study specifically seeks to assess 
whether increased rates of case management forall pregnant members would 
lead to decreases in the incidence of very low birth weight babies. Low birth 
weight was defined as babies weighing less than 2500 grams, very low birth 
weight babies were defined as weighing lessthan 1500 grams, and extremely 
low birth weight wasdefined as babies weighing less than 1000 gramsat birth. 
The study topic was well supported by a literature review and a review of issues 


relevant to health plan members. Resource information was quoted and used to 
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create an argument for this study. Thisisthe health plan’s submission asa clinical 
performance improvement project. The study justification included information 
on the physical, socialand emotional costs for members associated with low 

and very low birth rate infants. It also discussed, on the practical side, the 
monetary costs that care forthe mothers and infants create forthe health plan. 
The focus of the study isimproved services and outcomes formembers. A 
pertinent issue isalso a decrease in expenditures for the health plan. The stated 
goal of the project isto decrease the rate of preterm deliveries through 


aggressive obstetrical case management. 


The stepstaken by Mercy CarePlus included ean intervention and 
implementation of case management forall pregnant members. The goal was 
to increase members’ accessto prenatal care in an effort to ensure all 
appropnate health care wasreceived thereby reducing the incidence of low, 
very low, and extremely low birth weight deliveries. The health plan found that 
national trends indicated an increase in very low birth weight deliveries. In the 
Original study Mercy CarePlus’s tated goal was for theirtrend data to remain 
flat, however, the current goal isto decrease the rate of preterm deliveres 


through aggressive OBcase management. 


The study question is “Does an increased rate of OBcase management affect 
birth outcomes? Specifically, will increased ratesof OB case management lead 
to a decrease in the rate of low birth weight, very low birth weight, and 
extremely low birth weight babies?” This question is well constructed and 

provides direction to the study and outlinesthe study parameters. The orginal 
goalto “remain flat” did not appearto have a significant impact on the 
identified population. With the expanded goal of decreasing the rate of low 
birth weights the study promised to have a more profound impact of the 
population served. The population wasdefined to include any MCP member 


who waspregnant. Membersto be included in the study were to be identified 
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by the following methods of notification: 

e Pregnancy Risk Screening Forms 

e Baseline Health Assessment 

e Hospital Admissionsand Observations 

e Welcome Calls 


e OB Provider Referrals 


The study indicators attempted to provide for eany identification of members 
who were pregnant and early implementation of case management services. 
The study did include levels of risk, which determined the intensity of case 
management services. A Pregnancy Risk Screening tool wasused to evaluate 
pregnant members and to ensure the proper level of case management and 
ancillary services were provided to all pregnant members. The entire case 
management intervention was well described. The stated decision-making 
process fordetermining the level of care was “clinical and past experience.” 
This methodology was described in detail providing confidence in the decision- 
making criteria to determine risk. The information included a risk matnx that 
assisted in standardizing the decision-making process. Asthe study matured, 
changes were made to increase the effectiveness of the interventions. During 
the first sx months of 2007 Mercy CarePluscase-managed high risk pregnancies. 
Throughout the remainder of the study all pregnancies were case-managed. 


More significant outcomes were found asthe result of thisadded component. 


The narrative included a planned data analysis, a description of the 
measurement methodology, and data collected. Thiswasreflected onthe 
graphsand tables presented in the study. The expanded information provided 
includesan explanation of the process utilized to collect data and an 
explanation of the measurement cycles. This additional information assisted in 
defining causes and vanablesthat may impact the expected outcomes. During 


the penod in which this study was in processthe health plan expenenced a 
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merger with another plan. The effect of adding members and other variables 
that occured asthe result of this merger were discussed in the documentation 
provided. A brief explanation of the resulting growth in membership and how 


birth outcomesare standardized to membership is included. 


The study information does identify the Medzilla case management system as 
the source used to collect data and produce reports. Some confusion remains 
about the information included in the reports and the actual data included. The 
information these reports provided wasnot clarified or explained in any detail. In 
some instances what the reports included hasto be assumed. The namative 
provided assumed a systematic method for valid and reliable data collection. 
Additional explanation of the data attached would assist evaluators in 
determining whether consistent and accurate data wascollected throughout 
the study period. Pre and post-intervention analysis asserts a positive impact 
from the case management intervention. However, the narative doesnot 
provide statistical significance testing orother evaluative tools other than 
comparing rate data. Thiscreates difficulty in determining the validity and 
effectiveness of the intervention overtime. The study did provide a baseline and 
two additional years’ statistics. Conclusions were drawn from the data 
presented. The study asserted that the increased case management could be 
considered an effective intervention based on the decrease in low, very low and 
extremely low birth weights. Information provided defended this conclusion. 
However, it should be noted that the data presented appeared to provide 


evidence that the study did result in credible and interpretable findings. 


The stated goal of this study wasto achieve a decrease in the incidences of low, 
very low, and extremely low birth weight infants. Initially the study did not 
indicate that it would measure any variable factors, such as increased or 
decreased number of pregnancies, the increased or decreased number of 


members obtaining case management, or the influence of earlier determination 
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of risk forthe pregnant women. The improved study that began in] une 2005 
does include some of this information. The study continued during 2006 and 
2007. The outcomes were evaluated over thistime period. The planned 


interventions did appearto have a positive impact on MO HealthNet Members. 


Additional narrative discussing the impact of variablesand defending the 
outcome of the study are crucial to be able to draw an informed conclusions 
about the impact of the study interventions. It should be noted that this study 
can inform not only Mercy CarePlus, but all MO HealthNet Managed Care 
health plans, about the importance of this type of approach to impacting 
members’ healthcare and behavior. The study communicates the importance 
of thisapproach. With some additional clarity and explanation of the data 
available, the approach devised in this study could be considered a best 


practice in impacting member behaviorand member outcomes. 


CONCLUSIONS 

QUALITY OF CARE 

The best care in the most appropnate environment isthe assumed focusof the 
first PIP. The interventions attempted to incormorate methods to ensure that 
members sought services in a timely and appropnate manner, which would 


improve the quality of their livesas well asof the care received. 


It appearsthat Mercy CarePlus has begun utilizing the PIP process to inform the 
organization about the most effective methods to improve and provide quality 
healthcare. The health plan statesa desire to incorporate positive outcomes 

from the PIP into organizational operations. They articulate plansto use the PIP 
processto assist in program enhancement and organizational development in 


an effort to improve member services. 
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In the second PIP, the health plan sought to not only enhance the care pregnant 
women received, but also the quality of life fornewboms, whose mothers 
received sound prenatal services. The pregnant women served received a 
variety of services that they may never have been aware of if they did not have 
accessto the additional case management provided. The outcomesof the 
pregnancies followed during this period led to a decrease in the number of low, 
very low, and extremely low birth weights. The health plan asserts that giving 
newbomsa healthier start will enable improved outcomesin the quality of their 
lives. The narrative stated that this program will be continued as part of Mercy 


Care Plus’s routine case management process. 


ACCESS TO CARE 

The focus of the first PIP doesaddressaccessto care, and itisan overtly stated 
goal of the project. The intention of the interventions is to ensure that members’ 
have the best care in the best environment. By ensuring that members are 
aware of their PCP, orof available urgent care resources, and the services 
available in the office setting, ratherthan in an emergency room, members will 
be able to chose to receive care ina more appropnate environment. Using the 
Complex Case Management approach does provide strong advocacy for 
members and greatly improves the information they have available to make 


informed health care choices. 


The second PIP did enable members to have eany accessto prenatal care and 
intensive case management when appropnate. Using the case management 
processaseany in members’ pregnancy as possible provided the opportunity to 
inform members of all health plan services available to them, and to ensure that 
they had access to the provider of their choice whenever possible. When 


members were identified as “high risk,” accessto in-home as well as obstetrical 
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care created additional accessto a broad variety of supportive services. This PIP 
created an environment for fundamental preventive services by enhancing 


members’ accessto early and adequate healthcare. 
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TIMELINESS OF C ARE 

The educational efforts of the first PIP were implemented in an attempt to 
encourage membersto obtain the most timely and effective care possible. 
Members receiving treatment in a PCP office setting, orin an urgent care 
environment, rather than waiting until a crisis occursand using emergency room 
treatment are much betterserved. In the second PIP the issue of timeliness isone 
of the essential components of providing the best services through the case 
management efforts provided. Mercy CarePlus made significant efforts to 

ensure that members obtained necessary medical services at eany stages of 
pregnancy thereby ensuring the increased number of healthy births 


experienced. 


RECOMMENDATIONS 
1. The study design of Performance Improvement Projects should link the 
questions, the interventions, and the proposed outcomesto determine 
whether or not an intervention waseffective. Thiscan be accomplished 
by developing a logic model forthe PIPs at the planning stage, and 
ensuring that adequate narmative accompanies the data and information 


presented to make all necessary connections. 


2. Quartery measurement should be utilized if at all possible. This will provide 
information on the ongoing effects of the planned program. Data 
analysis should incorporate methodsto ensure that any resulting change, 
orlack of change, was related to the intervention. 


3. Provide enough namative to ensure that the readerunderstandsthe 
problem, the proposed interventions, the goalsand outcomes hoped for, 
and how the data presented relatesto all these issues and either supports 
program improvement, or is not effective. Narrative should also be 
provided to defend the conclusions and defined outcomes of the study. 
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This will provide justification, particulary if the processisto be an ongoing 


change in the health plan operations. 
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10.2 Validation of Performance Measures 


METHODS 

This section describes the documents, data, and persons interviewed forthe 
Validation of Performance Measures for Mercy CarePlus. Mercy CarePlus 
submitted the requested documents on J anuary 28, 2008. The EQRO reviewed 
documentation between J anuary 28, 2008 and J uly 1, 2008. On-site review time 
wasused to conduct follow-up questions and provide feedback and 


recommendations regarding the performance measure rate calculation. 


DOCUMENT REVIEW 
The following are the documents reviewed by the EQRO: 
e The Baseline Assessment Tool (BAT) submitted by Mercy CarePlus 
(prepared by Novasys) 
e Healthcare Research Associates’ (HRA) HEDIS 2007 Compliance Audit 
Report 
e NovaSys Health Network, LLC, policiesand procedures related to the 
HEDIS rate calculation process. 
e NovaSys Health Network, Mercy CarePlus electronic eligibility process 
e Data files from the HEDIS repository containing eligible population, 
numerators and denominators for each of the three measures 
e Decision rules & queries in the HEDIS 2007 repository used to identify 
eligible population, numerators and denominators for each of the three 
measures 


e Query result files from the repository 


The following are the data files submitted by Mercy CarePlus for review by the 
EQRO: 

e A (01) FUH File 1 Export to BHC.txt 

e B(01) FUH File 2 Export to BHC .txt 
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e C (01) AWC File 1 Export to BHC.txt 
e D (01) AWC File 2 Export to BHC.txt 
e (01) HEDIS Bridgeport EM for BHC .txt 
e EQRO Bridgeport 11708.txt 


INTERVIEWS 

The EQRO conducted on-site interviews with Mike Alvomoz, Molina Corporate 
Director, J ennifer Goedeke, Quality Improvement Manager, Robert Profumo, 
Medical Director, Ainette Martinez (representing Bridgeport Dental) and Michael 
Boone and Steve Sheldon (representing Novasys) on Tuesday, J uly 8, 2008. 
Michael Boone and Steve Sheldon of Novasys were responsible for calculating 
the HEDIS 2007 performance measures of Follow-Up After Hospitalization for 
Mental Illness and Adolescent Well-Care Visits, and Bridgeport Dental provided 


the Annual Dental Visit rate. 


FINDINGS 

Mercy CarePlus calculated the Adolescent Well-Care Visits, Annual Dental Visit, 
and Follow-up After Hospitalization measures using the Administrative Method. 
MO HealthNet Mangaed Care health plan to MO HealthNet Managed Care 
health plan comparisons of the rates of Annual Dental Visit, Adolescent Well- 
Care Visits, and Follow-Up After Hospitalization for Mental Illness were conducted 
using two-tailed z-tests. Forcomparisonsthat were statistic ally significant at the 
95% confidence interval (Cl), the z-score (z), the upperand lower confidence 


intervals (Cl), and the significance levels (p <.05) are reported. 


The HEDIS 2007 rate for Mercy CarePlus forthe Adolescent Well-C are Visits 
measure was 29.49%, which was significantly lower than the statewide rate forall 
MC HPs (34.81%; z =-0.33, 95% Cl: 28.89%, 40.74%; p <05). However, this rate was 
much higher than the rate (18.75%) reported by this health plan during the 2004 
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EQR report. 


The HEDIS 2007 rate forthe Follow-Up After Hospitalization measure isreported as 
two rates, one for 7-day follow-up and one for 30-day follow-up. The Follow-Up 
After Hospitalization rates reported to the SMA and the State Public Health 
Agency (SPHA) by Mercy CarePlus were 24.68% (7-day rate) and 46.31% (30-day 
rate). The 7-day rate reported wassignificantly lower than the statewide rate for 
allMO HealthNet Mangaed Care health plans (35.52%; z =-0.34, 95% CI: 22.96%, 
48.08%; p <.05); this rate wasalso lowerthan the 7-day rate (25.30%) reported by 
the health plan during the 2006 review. . The 30-day rate reported was 
consistent with the statewide rate forall MO HealthNet Mangaed Care health 
plans (60.06%; z =1.38, 95% Cl: 47.50%, 72.62%; p <.05); however, this rate was 
lower than the 30-day rate (49.10%) reported by the health plan during the 2006 


review. 


The reported rate for Mercy CarePlus for the Annual Dental Visit rate was 30.45%. 
This was consistent with the statewide rate for MO HealthNet Mangaed Care 
health plans (32.50%, z =0.04; 95% Cl: 29.30%, 35.69%; n.s.); however this rate is 
lower than the rate (31.13%) reported by the health plan during the 2005 review. 


The following sections summarize the findings of the process for validating each 
of the performance measures in accordance with the Validating Performance 
Measures Protocol. The findings from all review activities are presented 
according to the EQRO validation activity, with the findings foreach measure 
discussed within the activitiesasapproprate. Please referto the tablesin the 
main report for activities, ratings, and comments related to the CMS Protocol 


Attachments. 


DATA INTEGRATION AND CONTROL 
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Information systems management policies and procedures for rate calculation 
were evaluated consistent with the Validating Performance Measures Protocol. 
This included both manual and automatic processes of information collection, 
storing, analyzing and reporting. The EQRO was provided with a demonstration 
of the HEDIS repository. This wasdone through a remote connection from the 
Mercy CarePlus location in St. Louisto the vendorssystem in Little Rock, 


Arkansas. 


Forallthree measures, Mercy CarePlus was found to meet all of the criteria for 
having proceduresin place to produce complete and accurate data (see 
Attachment V: Data Integration and Control Findings). There were no biases or 
errors found in the manner in which Mercy CarePlus transferred data into the 


repository used forcalculating the HEDIS 2007 measures. 
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DOCUMENTATION OF DATA AND PROCESSES 

Data and processes used forthe calculation of measures were adequate (see 
Attachment Vil: Data and Processes Used to Calculate and Report Performance 


Measures). Mercy CarePlus met all criteria that applied forall three measures. 


PROCESSES USED TO PRODUCE DENOMINATORS 

Mercy CarePlus met all criteria forthe processes employed to produce the 
denominators of all three performance measures (see Attachment X: 
Denominator Validation Findings). Thisinvolved the selection of members eligible 


forthe services being measured. 


The Well-Care Visits measure contained an eligible population of 8,470. The 
EQRO found the age ranges, dates of enrollment, medical events, and 
continuous enrollment criteria were programmed to include only those members 
who met HEDIS 2007 criteria. 


Forthe Follow-Up After Hospitalization measure, a total of 393 eligible members 
were reported and validated by the EQRO. 


A total of 20,617 eligible members were reported and validated forthe Annual 


Dental Visit measure. 


PROCESSES USED TO PRODUCE NUMERATORS 

Allthree measuresincluded the appropnate administrative data ranges forthe 
qualifying events (e.g., well-care visits, follow-up visits, or dental visits) as specified 
by the HEDIS 2007 criteria (see Attachment XIll: Numerator Validation Findings). 


No medical record reviews were conducted. 


Forthe Adolescent Well-Care Visits measure, there were a total of 2,457 


administrative hits found in the data file; the health plan reported a total of 2,498 
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hits. Thus, the rate validated by the EQRO was 29.01% and the rate reported by 
the health plan was 29.49%, resulting in a bias of 0.48%. 


The Follow-Up After Hospitalization for Mental Illness measure 7-day rate 
contained a total of 97 administrative numerator events reported, of which all 97 
were able to be validated by the EQRO. Thus, the rate validated by the EQRO 
and the rate reported forthis measure were the same (24.68%), resulting in no 
bias. Forthe 30-day follow-up rates, the EQRO validated 182 hits and the health 
plan reported 182 hits. This resulted in a rate of 46.31% found by both the EQRO 


and the health plan, indicating no biasfound. 


The number of Annual Dental Visit hits reported by the health plan was 6,278; the 
EQRO wasable to validate a total of 6,273. The rate reported by the health plan 
was 30.45% and the rate validated by the EQRO was 30.43% this resulted ina 
0.02% estimated bias (overestimate) by Mercy CarePlus. 


SAMPLING PROCEDURES FOR HYBRID METHODS 

No medical record reviews were conducted orvalidated. CMS Protocol 
Attachment XIil; Impact of Medical Record Review Findingsand Attachment XV: 
Sampling Validation Findingsdo not apply to the Administrative Method. 


SUBMISSION OF MEASURES TO THE SIATE 

Mercy CarePlus submitted the DSTforeach of the three measures validated to 
the SPHA (the Missoun Department of Health and Senior Servic es; DHSS) in 
accordance with the Code of State Regulations (19 CSR §10-5.010 Monitoring 


Health Maintenance Organizations) and the SMA Quality Improvement Strategy. 


DETERMINATION OF VALIDATION FINDINGS AND CALCULATION OF BIAS 
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The following table summarizes the estimates of bias and the direction of the 
bias. There wasno bias found for the Follow-Up After Hospitalization for Mental 
Illness measure. The rates forthe Adolescent Well-Care Visits and Annual Dental 
Visit measures were slightly overestimated. However, both were within the 95% 


confidence interval for the rates reported by the health plan. 


Table 73 - Estimate of Bias in Re of MCP HEDIS 2007 Measures 





Direction of 
Estimate of Bias | Estimate 
Adolescent Well-C are Visits 0.48% Overestimate 


Follow- Up After Hospitalization (7 days) No bias n/a 
Follow-Up After Hospitalization (30 days) No bias n/a 
Annual Dental Visit 0.02% Overestimate 


FINAL AupIT RATING 

The Final Audit Rating foreach of the performance measures was based on the 
findings from all data sources summarized in the Final Performance Measure 
Validation Worksheet foreach measure. 


Table 74 - Final Audit Rating for MCP Performance Measures 





Final Audit Rating 
Adolescent Well-Care Visits Sub sta ntia lly Compliant 
Follow- Up After Hospitalization (7 days) Fully Compliant 
Follow-Up After Hospitalization (30 days) Fully Compliant 
Annual Dental Visit Sub sta ntia lly Compliant 





Note: Fully Compliant =Measure was fully compliant with State specifications; Substantially 
Compliant =Measure was substantially compliant with State specifications and had only minor 
deviations that did not significantly biasthe reported rate; A significant biasin the rate was defined 
asa numbercalculated by the EQRO that fell outside the 95% confidence interval of the rate 
reported by the health plan. Not Valid =Measure deviated from State specifications such that the 
reported rate wassignificantly biased. Thisdesignation is also assigned to measures for which no 
rate wasreported; Not Applicable =No MO HealthNet Managed Care Members qualified forthe 
measure. 


CONCLUSIONS 


Four rates were validated forthe health plan. Two of these rates were consistent 
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with; and two were significantly lower than the average forall MO HealthNet 


Managed Care Health Plans. 


QUALITY OF CARE 

Mercy CarePlus’s calculation of the HEDIS 2007 Follow-Up After Hospitalization for 
Mental Illness measure was fully compliant with specifications. This measure is 
categorized asan Effectiveness of Care measure and isdesgned to measure 
the effectiveness quality of care delivered. MCP’s 7-day rate for this measure 
was significantly lower than the average forall MO HealthNet Managed Care 
health plans the 30-day rate wasconsistent with the average. These ratesare 
also lower than the rates forthe same measure reported by the health plan 
during the 2006 review. Therefore, MCP’smembersare receiving a lower quality 
of care for this measure within the 7-day timeframe than the average MO 
HealthNet Managed Care member, and are receiving a quality of care for this 
measure consistent with the care delivered to the average MO HealthNet 


Managed Care member within the 30-day timeframe. 


The EQRO wasable to fully validate the rate reported by the health plan for this 


measure and therefore is extremely confident in the health plan’s reported rate. 


ACCESS TO CARE 

CarePlus’s calculation forthe HEDIS 2007 Annual Dental Visit measure was 
substantially complaint with specifications; this measure iscategonzed asan 
Effectiveness of Care measure. Because only one visit is required fora postive 
“hit”, this measure effectively demonstrates the level of accessto care that 
membersare receiving. The rate reported by MCP for this measure was 
consistent with the average forall MO HealthNet Managed Care health plans; 
however this rate was lower than the rate reported by the health plan during the 
2005 EQR. Although this rate was higherthan the rate reported by the health 
plan during the 2004 report, MCP’s members are receiving a quality of care that 
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is consistent with the care delivered to the average MO HealthNet Managed 


Care member. 


The EQRO wasable to validate this rate within the reported 95% confidence 


interval and therefore hasconfidence in the calculated rate. 


TIMELINESS OF C ARE 

Mercy Care Plus’scalculation of the HEDIS 2007 Adolescent Well-Care Visits 
measure was fully compliant. This measure is categorzed asa Use of Services 
measure and isdesigned to measure accessto and timeliness of the care 
defined. MCP’sreported rate forthis measure wassignificantly lowerthan the 
average forall MO HealthNet Managed Care health plans. Therefore, MCP’s 
members are receiving a lesstimely level of care forthis measure than the level 
of care delivered to the average MO HealthNet Managed Care health plan 
member. 

The EQRO wasable to validate this rate within the reported 95% confidence 


interval and thereby hasconfidence in the calculated rate. 


RECOMMENDATIONS 

1. The health plan’s 7-day rate for Follow-up After Hospitalization for Mental 
Illness and Adolescent Well-Care Visits rate were significantly lower than 
the average rate forall MO HealthNet Managed Care Health Plans. The 
EQRO recommendsthe health plan concentrate efforts to improve these 
rates. 

2. The health plan should considerthe use of medical record review (when 
allowed by HEDIS specifications) asa way to improve reported rates. 

3. Overall the health plansrates have trended down since the same rates 


were validated by the EQRO during previous Extemal Quality Reviews. 
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The health plan should explore reasons for these trends and make every 


effort to reverse these downward trends. 
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10.3 Validation of Enc ounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical Fields? 


Forthe Medical claim type, there were 120,736 encounter claims paid by the 

SMA forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete, accurate, 
and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete, accurate, 
and valid. 

5. The Outpatient Units of Service field was 100.00% complete, accurate and 
valid. 

6. The Outpatient Procedure Code field was 100.00% complete, accurate, and 
valid. 

7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 

8. The first Diagnosis Code field was 100.0% complete, accurate and 97.40% 
valid. 

9. Although the second through fifth Diagnosis Code fields are optional 


according to the Health Plan Record Layout Manual, all of these areas fell 
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well below the 100% threshold set by the SMA. The completeness, accuracy, 
and validity of the second, third, fourth, and fifth Diagnosis Code were 
47.79%, 26.19%, 14.81%, and 0.00% respectively. The remaining fields were 


blank (incomplete, inaccurate, and invalid). 


Forthe Dental claim type, there were 23,346 encounterclaims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. All fields examined were 
100.00% complete, accurate and valid. 
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Forthe Home Health claim type, there was zero (0) encounterclaims paid by the 
SMA forthe period J uly 1, 2007 through September 30, 2007. 


For the Inpatient claim type, there were 2,663 encounter claims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. 

The Inpatient Claim Type field was 100.00% complete, accurate and valid. 
The Recipient ID field was 100.00% complete, accurate and valid. 

The Admission Type field was 100.00% complete, accurate and valid. 

The Admission Date field was 100.00% complete, accurate and valid. 

The Discharge Date field was 100.00% complete, accurate and valid. 

The Bill Type field was 100.00% complete, accurate and valid. 

The Patient Discharge Status field was 100.00% complete, accurate and valid. 


The first Diagnosis Code field was 100% complete, accurate and valid. 


pop oO nN DYN FF WN 


The remaining Diagnosis Code fields fell well below the 100% threshold for 

completeness, accuracy, and validity established by the SMA. The second, 

third, fourth, and fifth Diagnosis Code fields were found to be 86.82%, 68.53%, 

54.15%, and 42.32% complete, accurate, and valid, respectively. The 

remaining fields were blank (incomplete, inaccurate, and invalid). 

10. The First Date of Service field was 100.00% complete, accurate, and valid. 

11. The Last Date of Service field was 100.00% complete and accurate, and 
valid. 

12. The Revenue Code field was 100.00% complete, accurate and valid. 


13. The Units of Service field was 100.00% complete, accurate and valid. 


14. Forthe Outpatient Hospital claim type, there were 59,669 encounter claims 
paid by the SMA forthe period J uly 1, 2007 through September 30, 2007. 

15. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

16. The Recipient ID field was 100.00% complete, accurate and valid. 

17. The First Date of Service field was 100.00% complete and accurate, and valid. 

18. The Last Date of Service field was 100.00% complete and accurate, and 
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valid. 

19. The Units of Service field was 100.00% complete, accurate and valid. 

20. The Outpatient Procedure Code field was 100.00% complete and accurate, 
and 80.73% valid. There were 11,712 entries of 60 invalid codes. 

21. The Revenue Code field was 100.00% complete, accurate and valid. 

22. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

23. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, they all fell well below 
the 100% threshold set by SMA forcompleteness, accuracy and validity. The 
second, third, fourth, and fifth Diagnosis Code files were 47.99%, 22.69%, 
10.84%, and 0.66% respectively. The remaining fields were blank (incomplete, 


inaccurate, and invalid). 


Forthe Pharmacy claim type, there were 73,775 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. All fields examined were 


100.00% complete, accurate and valid. 


What Types of Encounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for Mercy CarePlus, an enor 
analysis of the invalid entries wasconducted for fields which were lower than the 
100.00% threshold specified by the SMA. There were very few erors encountered 
in the critical fields examined acrossallclaim types. The Hospital Outpatient 
Procedure Code field contained a large proportion of invalid entries. These 
invalid codes ranged from 250-990. 


What is the Level of Volume and Consistency of Servic es? 
When companing the rate of encounter claim types per 1,000 members, Mercy 
CarePlus demonstrated significantly lower ratesthan the average forall MO 
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HealthNet Managed Care Health Plans for the Outpatient Hospital and Inpatient 
claim types. Thismay be a function of provider panel composition or claims 
administration. The possibility of incomplete data cannot be ruled out given the 
consistent pattem of low rates acrossclaim types. Another possible explanation 


islessaccessto care formembers, ora healthier member population. 
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To What Extent do the Claims in the State Encounter Claims Database Reflect the 
Information Doc umented in the Medical Record? Whatis the Fault/ Match Rate 
between State Encounter Claims and Medical Records? 


To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each MO HealthNet Managed 
Care Health Plan were randomly selected from Medical claim types for the 
period of J uly 1, 2007 through September 30, 2007 for medical record review. Of 
the 280,189 encounter claim types in the SMA extract file for) uly 1, 2007 through 
September 30, 2007, 100 encounters were randomly selected. Providers were 
requested to submit medical records for review. There were 94 medical records 
(94.0%) submitted for review. Encounters for which no documentation was 
submitted were unable to be validated. The match rate for procedures was 
54.00%, with a fault rate of 46.0% The match rate for diagnoses was 41.0%, with 
a 59.0% fault rate. 


What Types of Errors Were Noted? 

An eror analysis of the erors found in the medical record review for procedure, 
diagnosis, drug name, and drug quantity wasconducted. Forthe diagnosis 
code in the medical record, the reasons for diagnosis codesnot matching the 


SMA extract file were missing (n =50) and incorrect (n=9). 


Forthe procedure code in the medical record, the reasons for procedure codes 
in the SMA extract file not being supported by documentation in the medical 
record were missing information (n =42) and upcoded codes (n =4). Examples 
of missing information included no code; codes listed that were not supported, 


orcodesthat did not match the procedure description. 
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To what extent do the MO HealthNet MC HP paid/ unpaid enc ounter claims match 
the SMA paid database? 

Since Mercy CarePlus included intemal control numbers that matched those of 
the SMA, the planned analysis of comparing MO HealthNet Managed Care 
health plan encounter data to the SMA encounter claim extract file was 
performed. The SMA defined “unpaid claims’ asthose claims that the health 


plan denied for payment, unpaid claimsdo not include claims paid via a 





capitation plan. 


Forall claim types, the health plan only submitted claims with a status of “paid”. 
The EQRO matched all of these claimsto the files contained in the SMA 
database. Thus, 100.00% of the MCP submitted encounters matched with the 


SMA encounter records 


What Problems are there with How Files are Compiled and Submitted by the MO 
HealthNet Managed Care health plan? 


The analysis of comparing Mercy CarePlus (MCP) encounter data to the SMA 
encounter claim extract file wasconducted based on the file submitted by MCP 
that contained all claims for the selected sample of DCNs. While MCP did 
submit the data in the requested format (see Appendix 7) forthe MO HealthNet 
Managed Care Members represented in the encounterclaim sample selected 
by the EQRO for validation, there were no unpaid ordenied claims submitted. 
There were no unmatched claims that were in the MCP encounter file and 
absent from the SMA data. Thus, 100.00% of the MCP submitted encounters 


matched with the SMA encounter records. 


What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 


There are no data quality issues specific to this MO HealthNet Managed Care 


health plan. The data quality issue that continuesto be a challenge forthe 
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EQRO isthe lack of a unique identifierto match unpaid ordenied claimsto 
claims data present in the SMA database. 
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CONCLUSIONS 

STRENGTHS 

1. Allencounterdata was submitted in the specified format and included 


intemal control numbers (IC Ns) which allowed the EQRO to conduct planned 
comparisons of the MCHP and SMA data files. 

The critical field validation of all six claim types resulted in few fields under the 
SMA established threshold of 100.00% accuracy, completeness, and validity. 
The critical fields examined forthe Dental, Pharmacy and Inpatient claim 
types were 100.00% complete, accurate and valid. 

The critical fields examined for Outpatient Hospital and Outpatient Medical 
were 100% complete and accurate. 

Data was submitted in the requested format for encounter validation and all 
claim types were accessed. 

Mercy CarePlus submitted more encounter medical records for review (n = 
94) than they have during past reviews. 

Claim Status (Paid, Denied, & Unpaid) was submitted. 


AREAS FOR IMPROVEMENT 


1. 


Mercy CarePlus has the lowest rate of access per 1,000 members in the 
encounter categories (Outpatient Hospital, and Inpatient claim types). 
Mercy CarePlus did not have any Home Health claims during the period 
reviewed. 

The Outpatient Hospital procedure code field was 80.73% valid. There were 


11,712 entries of 60 invalid codes. 


4. The health plan reported no Home Health encounter claims during the review 
period. 
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RECOMMENDATIONS 

1. The health plan should examine the rate of claims per 1,000 members across 
claim types and the rate of rejected claims foreach claim submission format 
(UB-92, NSF/CMS 1500, NCPDP 3.0) overtime to examine the consistency in 
claims submission and identify issues for data submission. The accessto care 
should also be examined asa possible reason forthe lower rates of 
encounter claims per 1,000 members. 

2. The SMA should examine and revise asneeded intemal system edits for 
invalid procedure codesin the NSF/CMS 1500 file layout and run validity 
checks afterthe programming of new edits. 

3. Forthe Outpatient Hospital claim type, improve the rate of valid procedure 
codes. 
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10.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Priorto the site visit, documentation was received and reviewed regarding the 
MO HealthNet Managed Care Health Plan’s compliance with the State 
contract. The Extemal Quality Review Organization (EQRO) reviewed contract 
documents with the staff of the MO HealthNet Division (MHD). It isnoted that 
Mercy CarePlus is in itssecond year of operationsasa MO HealthNet Managed 
Care Health Plan. Thishealth plan previously operated underthe name of 
Community CarePlus. Thisaction became effective with the current MO 
HealthNet Managed Care contract that went into operation on July 1, 2006. The 
new health plan, Mercy CarePlus currently hascontracts to provide servicesin all 
three Regions, although their largest population remains in the Eastem Region 
with approximately 56,000 members. They curently report having over 5,500 
membersin the Central Region, which isa substantial increase overthe 1000 
members reported in 2006. In the Westem Region the health plan now serves 
nearly 8000 members, which is another substantial increase over the 3000 
members served in 2006. They continue to develop their emerging census in the 
two additional service regions. The MO HealthNet Managed Care Health Plan 
disc ussed in this report will be compared to the health plan fommeny named 


Community CarePlus when required. 


On-site review time wasused to conduct interviews with Member Services’ Sta ff 
and Supervisors, and separately with Case Management Staff and Supervisors. 
This approach wasutilized to validate what practices occured when serving 
members. These interactionsand responses were compared to policy 
requirements to ensure that both are within the scope of the contractand are 


conducted in a manner that meets or exceeds federal regulations. 
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A detailed interview tool, individualized for Member Services’ Staff and for Case 
Management staff, wasutilized to ensure that all pertinent elements of the 
federal regulations were addressed in the interview process. Additionally, an 
interview tool wasconstructed foradministrative staff to validate and clarify 


these practices and to follow-up on questions raised from the interviews. 
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Additional document reviews occured on-site to validate any policies and 
procedures that were in question after disc ussions with the SMA, and afterthe 
review of the health plans annual report. Thisdocument review occured priorto 


the on-site review. 


DOCUMENT REVIEW 
The following documents pertaining to Mercy CarePlus were reviewed prorto 


and at the on-site visit: 


The Division of Medical Services supplied: 
e State of Missouri Contract Compliance Tool (including DMHN responses 


and comments) 


The following documents were requested and reviewed on-site: 
e Member Handbook 
e 2007 Marketing Plan and Materials 
e Provider Handbook 
e Policy Tracking Log 
e Memberand ProviderGrievance and Appeal Logs 
e Medical Management Policy and Training Requirements 
e Credentialing Policies 


e Case Management Policy 


Additional documentation made available by Mercy CarePlus included: 
e Organizational Chart 
e Access Standardsand Compliance Policy 
e Quality Improvement Committee Meeting Minutes 
e MCP Welcome Packets, with comespondence, postcards, privacy/HIPPA 


information 
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e 2006 Quality Monitoring Log 


The medical management and credentialing policy reviewed indicates that 
Mercy CarePlus is following NCQA Standards. All of these policieshave been 
submitted to the SMA fortheir final approval. It wasdetailed and appeared to 
comply with federal regulations. Quality Improvement Committee Meeting 
Minutes were also reviewed. They contained reports of monthly activities which 


related to the actual goals of the health plan. 


Documents reviewed indicated that the health plan is moving toward NCQA 
accreditation and indicated a significant change in quality focus. The health 
plan was purchased by Molina Healthcare in November 2007. No changesin 
name oroperations occured during 2007. Itisnoted here asa number of 


documents reviewed reflected the Molina Healthcare name and format. 


INTERVIEWS 
Interviews were conducted with the following groups: 


Plan Administration 
e Zarina Sparing- Interim CEO 
e Robert Profumo, MD - Chief Medical Officer 
e Nancy Zmuda - Director, Utilization Management 
e Steve Mead - Director, Compliance and Regulatory Affairs 
e Tracy Hay - Director, Member Services 
e JenniferGoedeke - Director, Quality Improvement 
e Robin Woolfolk - Director, Customer Service 


e jodi Giordano - Director, Provider Contracts 


Member Services Sta ff 
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J acqueline McCarter - Lead Member Services Representative 
Robin Woolfolk - Manager, Member Services 

LaShonda Kahill - Member Services, Quality Auditor 

Tracy Hay - Director, Member Services 

J ennifer Goedke - Director, Quality Improvement 


Steve Mead - Director, Compliance and Regulatory Affairs 
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Case Manager Staff 
e Chere Brown - Manager, Case Management/Prior Authonzation 


e AprilGross- Complex Case Manager| 

e Diane J ellison - Complex Case Manager| 

e Nancy Zmuda - Director, Utilization Management 
e Mary Luley - Manager, Utilization Management 

e jenniferGoedeke - Director, Quality Improvement 
e Dr. Robert Profumo - Chief Medical Officer 


FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

Mercy CarePlus continued their efforts to track and monitor all policy required to 
be submitted to and reviewed by the SMA. Thisincluded policy and procedures 
for initial and annual approval, as well as marketing matenals. Additionally, the 
MCHP developed an inventory of all written materials or purchased materials 
that must be approved by the SMA pnorto being shared with members. A 
binderincluding all Annual Marketing Materials and the annual marketing plan 


wascompiled and shared during the on-site review. 


The Member Handbook was approved by the SMA and continues to be 
recorded in a format to be shared with members who are visually impaired or 
have other challenges with written maternal. Certified interpreters for deaf or 
non-English speaking members are provided asneeded. The Intemational 
Institute and the Language Access Metro Project (LAMP) are the primary 
resources used for interpretive services by Mercy CarePlus. The MCHP reports 
receiving a numberof calls every month that required interpretive services, these 
callshave been handled in a routine manner. They do report there have been 


no new language requests in the past year. 
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Training is regularly provided to ensure that the Mercy CarePlus Call Center staff 
isknowledgeable about members rights and responsbilities. Training sessions 
were held on two State holidays, when there are nomally fewercalls. These 
training sessions focused on customerservices and medical management with a 
focuson members’ rights and responsibilities. All incoming calls are monitored 
and additional in-service training and coaching is provided based on 
information gathered. Previously, Call Center staff rotated to provide 24-hour 
coverage on holidays and weekends. Currently the MCHP contracts with Team 
Health, a nurse advice line service, for afte-hour coverage. This service is 
available twenty-four (24) hours, seven (7) daysperweek. The Call Center sta ff 


also assists in contacting new members. 


Member Services staff exhibit a strong degree of advocacy in providing services 
to health plan members. They make every effort to support new members with 
information and assistance. Member Services staff provides names, geographic 
locations and availability of providersand other supportive health care services. 
They encourage membersto ask questions and provide answers, orobtain 
necessary information for other sections of the health plan to adequately 
respond to the member. Staff reports that they always attempt to go through 
the Member Handbook with the new health plan membersto ensure familiarity 
with all the sectionsand the information provided. They also inform health plan 
members about the health plan website. This staff reports that health plan 


membersare using the website in increasing numbers. 


Mercy CarePlus continuesto enhance case management services to members 
with special needs. They review all sourcesto identify membersin need of case 
management, and provide them with individual attention as quickly as possible. 
Case managers provide direct servicesand track all pregnant members. 


Pregnant members receive varying levels of case management services, based 
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on an assessed level of risk. The members with a moderate orhigh level of risk 
received enhanced case management throughout their pregnancy and post 
partum term with the goal of reducing the number of low birth weight babies. 
The rate of Obstetrical Case Management hasincreased across all three 
Regions. The health plan hastracked statistics indicating that babiesbom at 28 
to 36 weeks are living, which has increased the numberof newbom inpatient 
daysin the hospital. Members, with other healthcare issues, that are targeted for 
case management include those who have high blood lead levels, have 
identified special healthcare needs, and any catastrophic illness. They currently 
have three case management coordinators who assist members in obtaining 


services after-hours. 
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The MCHP now usesa web-based case management system. This system assists 
in making objective and balanced decisionson services available, such as 
durable medical equipment. This system is being implemented incrementally. 
They currently have accessto the case review processand have the capability 
of generating lettersto members. The Lead Case Manager maintainsa 
database with information provided by the SMA, and isactive in educating 
providers regarding the use of capillary testing to encourage blood lead level 
tests for children. This information will be in the new case management system in 
the near future. The health plan’s Medical Director meets with case 
management staff to discuss casesand holds weekly case conferences. This 
type of support was beneficial to the health plan and to case management 


activities. The case management staff conducts outreach to hospitals. 


Case Managers reported receiving referrals from a variety of sources. These 
include Member Services staff, Pre-authorization staff, providers, the SMA system, 
concurent review nursesand behavioral health case managers. They gave an 
example of receiving a referral from pre-authorization nurses fora member 
requesting home health services. This member was not receiving case 
management, but was immediately referred. The health plan case managers 
also review claims data, patient notes, pharmacy data and the 24-hour nurse 
line lists to ensure that all necessary referrals are received. The case managers 
did discuss that members have the nght to accept or refuse both case 
management and any medical treatment offered. They make every effort to 
ensure that membershad accessto special servicesand required medical 
treatment. They could also provide examples of the methods they utilize to 
ensure that members are aware of theirright to have an impact on treatment 


planning. These staff exhibit a clear commitment to the members they serve. 


The rating for Enrollee Rights and Protections (100.0%), which isa significant 


increase overthe 2006 rate (53.8%), indicates that Mercy CarePlushas made a 
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concerted and successful effort to have written policiesand procedures 
submitted to and approved by the SMA. It isto be noted that the health plan 
made improvement in thisarea, hasimproved tracking and intemal processes, 
and isin the process of completing policy development and submission each 
year, which has now resulted in the current rating. Mercy CarePlus exhibited a 
businesslike approach and commitment to continue their efforts to improve in 
the completion and submission of required policiesand procedures. Their 2006 
stated goal wasto become fully compliant with all MO HealthNet Managed 
Care contract requirements and federal regulations. The outcome of this review 
isevidence of their efforts in this regard. 


Table 75 - Subpart C: Enrollee Rights and Protections Yearly Comparison (MCP) 





MCP 
Federal Regulation 
2005 2006 2007 
438.100(a) Enrollee Rights: General Rule 2 1 2 
438.10(b) Enrollee Rights: Information Requirements 1 al 2 
438.10(c)(3) Alternative Language: Prevalent Language 2 2 2 
438.10(c)(4,5) Language and Format: Interpreter 1 2 2 
Services 
438.10(d)(1)(i) Information Requirements: Format/Easily 2 1 2 
Understood 
438.10(d)(1)(ii)and (2) Information Requirements: Format 1 1 > 
Visually Impaired, and Limited Reading Proficiency 
438.10(f) Information for All Enrollees: Free Choice, etc. 1 2 2 
438.10 (g) Information to Enrollees: Specifics/Physician 2 > 2 
Incentive Plans 
438.10(i) Special Rules: Liability for Payment/Cost 1 > 2 
Sharing 
438.100(b)(2) (iii) Enrollee Rights: Provider-Enrollee 2 1 > 
Communications 
438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 1 2 2 
Directives 
438.100(b)(3) Right to Services 1 il 2 
438.100(d) Compliance with Other Federal/State Laws 2 2 2 
Number Met 6 7 13 
Number Partially Met 7 6 0 
Number Not Met 0 0 0 
Rate Met 46.2% 53.8% 100.0% 


Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 
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BEHAVIORAL HEALTH 

MHNet is the Behavioral Health Organization (BHO) that subcontracts with Mercy 
CarePlus for mental and behavioral health servicesformembers. Thiswasthe 
first full year of operation forthis BHO at Mercy CarePlus. The health plan 
reported a smooth transition and no specific problemsoccuning in terms of 
members accessing services during the 2007 program year. The BHO makesan 
effort to assist members in obtaining timely accessto services. Members are 
encouraged to contact the BHO to make appointments, particulary if they have 
contacted providers directly without success. Providers are listed on their 
website in an effort to ensure that members have this information. Adequate 
providers have been enlisted in both the Central and Westem Regions to meet 
service needsin these areas. The BHO hasmade an effort to improve 
coordination between behavioral health providersand the member's primary 


care physician. They are committed to continuing improvement in this area. 


QUALITY ASSESSMENT AND PERFORMANCE IMPROVEMENT 

Access Standards 

Mercy CarePlus continues to make improvements in the area of access 
standards during 2007. The health plan had a schedule to submit policies and 
procedures to the SMA forannual review asrequired. The health plan explained 
that currently all authorizations were received from providers telephonically. 
Mercy CarePlus staff measured the requestsand accompanying information 
against InterQual criteria. If the decision wasto deny the authorization, the 
information wasreviewed by the medical director priorto entry into the health 
plan’ssystem. All authorizations were tracked and monitored. The health plan 
required pnor authonzation of all inpatient stays, MRI, CTscan, physical therapy, 
occupational therapy, speech therapy, certain medications, home health 
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servicesand pain management. Mercy CarePlus made it clear that there isa 
system in place to pay foremergency services regardless of who providesthem. 
Policy in thisarea and addressing the method for covering post-sta bilization 


services has been rewritten and submitted to the SMA forapproval. 


Mercy CarePlus decreased the timeframes for responding to authorization 
requests. They updated their policy to ensure that denials would be overtumed 
when adequate information was provided. Tracking and trending of information 


occured and isreviewed ona monthly bass. 


Member Services reports receiving 15-20 calls perday regarding closed panels. 
The health plan hasimplemented a number of strategiesto cope with this 
problem. Most providers agree to see siblings of children who are already 
members or patients. Assignments are done with the consultation of the 
member whenever possible. If auto assignments are required, distance is the 
main consideration. Direct contact with physicians to assist members with 
appointments is made whenever necessary. The health plan reportsthat adding 
several hospitals and physician groups not previously available during 2006 has 
assisted in adequately serving members in the Eastem Region. Mercy CarePlus 
reported that although several large hospitals were not in their network, they 
maintained a strong relationship with those systems and would create out-of- 


network agreements for members if the need arose. 


Mercy CarePlus reported that they continue to struggle with finding several 
specialty providers, particularly pediatric neurologists, heumatologists, and 
orthopedic surgeons. The health plan hasbeen able to negotiate for these 
services because the Provider Relations staff developed individualized 
relationships with providers. They did report paying orthopedic surgeons 100% of 
billed charges. 
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Mercy CarePlus assessed provider availability annually when producing their 
report to the Missoun Department of Insurance, Financial Institutions and 
Professional Registration (MDIFP). In 2006 the MCHP reviewed the availability of 
24-hour coverage by providers, as required in their MO HealthNet Managed 
Care Contract. The MCHP monitored provider telephone logs, conducted blind 
telephone testing, and obtained input from providers directly. Mercy CarePlus 
reported a large degree of success in this area, but admitted that there were 
providers who needed work. During 2007 the health plan has continued follow- 
up efforts with providersto ensure that timely and adequate health care service 
delivery improved. The health plan continues provider education and testing in 
thisarea. The health plan reported that they contracted with all of the Federally 
Qualified Health Centers (FQHCs) in the three regions. This effort improved 


daytime and some after-hours access. 


Member Services staff were asked about service availability. They gave 
examples of providing members with information about all services available, 
and the location of urgent care centers and physicians who have after-hours 
clinics. They also gave examples of directly contacting providers to ensure that 
members obtained timely appointments, to clarify information, and to locate 
specialists. The Member Services staff also contacts the Provider Relations staff to 


relay issues for follow-up contacts, clarification, or problem resolution. 


Member Services staff also described activities within the health plan to obtain 
information and feedback from members, such as retum telephone contacts 
and surveys. They utilize this information to improve customer service and to 
assess member satisfaction. The Member Services staff reports that they have 
leamed how to listen to members and identify if a family member has special 
needs. They immediately refer these members forcase management and more 
in-depth services. The referral and need for information is recorded in the health 


plan system to allinvolved staff members are aware of the membersneeds and 
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follow-up contact. 


Case Managers discussed their efforts to ensure that members have accessto all 
the services they require, specifically for members with special health care 
needs. They encourage membess to utilize the nurse help line and educate them 
on all health care resourcesthat are available. The case managerscontact 
providers, review utilization, and participate in treatment planning to ensure that 
members have accessto all required health care services. The case managers 
report that membersdo not curently receive a written copy of their treatment 
plan. However, theirnew case management system will generate letters that 
include the treatment plan so members will have thisin a written form. The case 
managers explained that the member supplies the information necessary to 
develop the treatment plan, and the case manager ensures that there are no 
gapsin providing effective treatment. Coordination of services, with medical 
providers, and with behavioral health servicesisan essential component of their 


case Management process. 


Ratings for compliance with Access Standards (100.0%) reflect a serous attempt 
by the health plan to complete required policy to meet the requirements of the 
MO HealthNet Managed Care contract and federal regulations. This rating isan 
improvement over 2006 (88.2%). This isthe first yearthat all required policy and 
procedure are complete. Mercy CarePlus will continue their efforts to develop 
necessary policy and practice to be in fullcompliance. Observations made at 
the time of the on-site review indicated that these efforts were continuing and 


fullcompliance wasan ongoing health plan goal. 


Member Services added two Spanish speaking and one Bosnian speaking staff 
members when the Central and Westem Regions were added to their contract. 
They also have one staff member who speaks four (4) languages including 


German. The health plan believes they have adequate diversity and provides 
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members enough altemativesto be comfortable when contact ismade. 


Table 76 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (MCP) 





Federal Regulation ee 
438.206(b)(1)(i-v) Availability of Services: Provider Network 2 2 2 
438.206 (b) (2) Access to Well Woman Care: Direct Access 1 2 2 
438.206(b)(3) Second Opinions 2 2 2 
438.206(b)(4) Out of Network Services: Adequate and Timely Coverage 1 2 2 
438.206(b)(5) Out of Network Services: Cost Sharing 1 1 2 
438.206(c)(1)(i-vi) Timely Access 1 2 2 
438.206(c)(2) Provider Services: Cultural Competency 2 2 2 
438.208(b) Care Coordination: Primary Care 1 2 2 
438.208(c)(1) Care Coordination: Identification 2 2 2 
438.208(c)(2) Care Coordination: Assessment 1 2 2 
438.208(c)(3) Care Coordination: Treatment Plans 1 2 2 
438.208(c)(4) Care Coordination: Direct Access to Specialists 1 2 2 
438.210(b) Authorization of Services 2 2 2 
438.210(c) Notice of Adverse Action 2 2 2 
438.210(d) Timeframes for Decisions, Expedited Authorizations 2 2 2 
438.210(e) Compensation of Utilization Management Activities 2 2 2 
438.114 Emergency and Post-Stabilization Services 1 1 2 
Number Met 8 15 17 
Number Partially Met 9 2 0 
Number Not Met 0 0 0 


Rate Met 47.1% 88.2% 100.0% 
Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Structures and Operation Standards 

Mercy CarePlus continued to develop their credentialing standards. The health 
plan assured that all providers maintained licensure and the right to practice in 
Missoun. Source One wasemployed to runa monthly data scan against 


licensing listings. This process enabled the health plan to maintain current 
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licensure information. Mercy CarePlus reported that they were current on all 
credentialing fornew physiciansand on delegated credentialing. The health 
plan developed a work plan to ensure that the remaining provider list would be 
Current during the coming year. The health plan reported that they are current 
on all providers due forcredentialing. Delegated credentialing isgranted to the 
SSM hospital system and to the BHO MHNet. Certification of the delegated 


credentialing iscompleted by Source One. 


During 2006 an after-hours survey wasconducted that indicated problems in 
severalareas. One of these wastelephone access to twenty-four hour primary 
Care physician (PCP) availability. During 2007 Mercy CarePlus worked toward 
making after-hours services available to prevent the unnecessary use of 
emergency rooms. The health plan provided education to members on the use 
of the Team Health Nurse Advice Line, and contacted PCPs directly if problems 
were not resolved. Provider representatives visited these PCP offices every six 
weeks for follow-up, and provided additional assistance to trouble shoot specific 


issues. Mercy CarePlusdeveloped an oversight tool forthis purpose. 


Mercy CarePlus has instituted a more rigorousapproach to training to ensure 
that staff isaware of new policies and procedures. Thishasled to improved 


servicesand improved interdepartmental communications. 


Member Services staff report being aware of the policiesand procedures to 
utilize ifa health plan member callsand requests disenrollment. They do ask 
questions to ensure that the call isnot the result of an issue that can be resolved, 
orrefered onaSa gnevance orappeal. When the member is adamant, the 
process for disenrollment is started immediately. Thisdoes not occur with any 
regulanity, but they state that they attempt to be ashelpful and 
accommodating as possible. If the member calls regarding the need foran 


authorization, or any other activity that should occurimmediately, Member 
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Services obtain as much information as possible, and then make the appropnate 
referral forthe member. This referral may be to case management, utilization 
management, orthe gnevance and appeals unit. The staff members 
interviewed gave examples that make it clearthat they understand these 


processesand that they act in the members’ behalf. 


In addition to care coordination, case managers discussed the use of practice 
guidelines and other information used to ensure that special issues are addressed 
in serving members. The Case Management staff works with the Utilization 
Review section and with the concurent review nurses to ensure that all members 


receive the health care services needed. 


The rating for Structure and Operation Standards (100%) reflects the timely and 
efficient submission of policy to the SMA for their review and approval. This is an 
improvement overto 2006 rating (80%). The MCHP understood that continued 
efforts in this area of practice willbe needed. Their progress in this area of 
compliance isnoteworthy. Observations at the time of the on-site review 
support Mercy CarePlus’s success at identifying and improving areasthat had 


previously been problematic. 


Table 77 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (MCP) 











Federal Regulation 





2005 2006 


; 1 2 





438.214(a,b) Provider Selection: 
Credentialing/Recredentialing 
438.214(c) and 438.12 Provider Selection: 2 
Nondiscrimination 


2 
438.214(d) Provider Selection: Excluded Providers 1 2 
2 


438.214(e) Provider Selection: State Requirements 2 


438.226 and 438.56(b)(1-3) Disenrollment: 
Requirements and limitations 


438.56(c) Disenrollment Requested by the Enrollee 2 
438.56(d) Disenrollment: Procedures 2 
438.56(e) Disenrollment: Timeframes 1 
1 
1 


Hh 


438.228 Grievance System 


438.230(a,b) Subcontractual Relationships and 
Delegation 
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Number Met 4 8 10 
Number Partially Met 6 2 0 
Number Not Met 0 0 0 
Rate Met 40.0% 80.0% 100% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Measurement and Improvement 

Mercy CarePlus has developed and implemented specific practice guidelines 
with providers at the time of the 2007 review. The health plan has now instituted 
the National Heart, Lung, and Blood Guidelines for asthma care for adults and 
children. NIH clinical guidelinesand Kansas City guidelines were adopted for 
several other areas of healthcare delivery. Thisinformation and methods to 


utilize these guidelines have been distributed to all health plan providers. 


Mercy CarePlus instituted a number of Quality Assessment and Performance 
Improvement activities during 2007. Their Quality Improvement group meets 
quarteny and includes local physicians who actively participated. The health 
plan’s goal of providing quality services to members was the focus of the group’s 
discussions. Mercy CarePlus viewed this initiative ashaving a postive effect on 
the performance and focusof the MCHP. The QA &1 group is currently looking 
at tracking and trending the health plan system to ensure memberaccessina 
timely and efficient manner. The health plan hopesto use this information to 


ensure that all members have adequate access to those services. 


Mercy CarePlus worked with the Missourn Department of Health and Senior 
Services (DHSS) to obtain historical immunization information since November 
2004. They continue to use the MOSAIC system to obtain lead and immunization 
sta tistics. 


Mercy CarePlus reported that the Quality Assessment and Improvement 
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program was involved in the development of policy regarding member 
Grnevance and Appeals, and provider Complaints, Grievancesand Appeals. 

The health plan set up an intemal monitoring process and found a continued 
successin sending letters according to policy throughout 2006. This successhas 


also continued throughout 2007. 


Mercy CarePlus submitted two Performance Improvement Projects (PIPs) for 
validation. Although these PIPs lacked complete maturity to allow for validation, 
they indicated substantial improvement in utilization of this processasa tool for 
MCHP growth. The structure of both PIPs followed the federal protocol and 
showed a great deal of potential. These PIPs indicated an increased degree of 
understanding of the importance of the PIP processin improving health plan 


operations and health care servicesto members. 


This section doesnot directly apply to the Member Servicesand Case 
Management staff. However, both report that members often asked relevant 
questions about issues that are covered by practice guidelines. The case 
managers gave one example of a member, who isa registered nurse, asking for 
the asthma practice guidelines. She related that she wasnot sure herchild was 
being treated propery and wanted to discuss this with the physician. This 


information was supplied to the member priorto theirappointment. 


The MCHP submitted all required information to complete the Validation of 
Performance Measures forall three measures, as requested. The specific 
outcomes of the Performance Measure outcomes are discussed in the 
appropnate section of thisreport. Mercy CarePlus continued to operate a 
health information system within the guidelines of that protocol. All encounter 
data requested was provided in the correct format. The complete details of 
each of these areas of validation can be reviewed within specific sections of this 


report. 
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The rating forMeasurement and Improvement (100%) reflects a continued 
diligence toward meeting the requirements of the MO HealthNet Managed 
Care contract and federal regulations. These policiesand procedures have all 
been submitted to and approved by the SMA. 
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Table 78 - Subpart D: Quality Assessment and Performance Improvement Measurement and 
Improvement Yearly Comparison (MC P) 


MCP 
Federal Regulation 
2005 2006 
438.236(b)(1-4) Practice Guidelines: Adoption 1 2 2 
438.236(c) Practice Guidelines: Dissemination 1 2 2 
438.236(d) Practice Guidelines: Application 2 2 
438.240(a)(1) QAPI: General Rules 1 2 2 
438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCHP 1 2 2 
Quality Improvement and PIPs 
438.240(b)(2)(c) and 438.204(c) QAPI: Performance 2 2 
Measurement 
438.240(b)(3) QAPI: Basic Elements/Over and Under Utilization 
438.240(b)(4) QAPI: Basic Elements regarding Special 2 > > 
Healthcare Needs 
438.240(e) QAPI: Program Review by State NA NA NA 
438.242(a) Health Information Systems 2 2 2 
438.242(b)(1,2) Health Information Systems: Basic Elements 2 
438.242(b)(3) Health Information Systems: Basic Elements 2 2 2 
Number Met 6 11 11 
Number Partially Met 5 0 
Number Not Met 0 0 0 


Rate Met 54.5% 100.0% 100% 
Note: Regulation 438.240(e) refers to program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
process and isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable to the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MC OPs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 





Grievance Systems 

Mercy CarePlus completed and submitted all required policy and procedures to 
make theirGrievance System compliant with MO HealthNet Managed Care 
contract requirements and federal regulations. The health plan put processes in 
place to capture memberand providercontacts. The health plan continues to 
report that they are working smarter and have developed better 
communication between intemal departments. Thisenhanced their ability to 
track and respond to member grievance and appeals, as well as provider 
complaints, grievances, and appeals. To accomplish the additional 
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responsibilities in the area of response to member gnevance and appeals, and 
provider complaints gnevances and appeals, Mercy CarePlus has three 
coordinatorsin place. The additional staff added in the past yearhas assisted in 
obtaining success for this portion of thisprogram. The health plan developed an 
on-line tracking system that contributes to timely responses in the complaint, 


gnevance and appeal process. 


Member Services staff reports that they receive many calls regarding member 
concems. They request a brief overview of the issue, record pertinent 
information in theirtracking system, and immediately refer the issue to the 
Grievance and AppealsCoordinator. They relate that this coordinator then 
contact the memberand discussesthe gnevance and appeals process with the 
member, and assist the member in negotiating the system. The Member Services 
staff is aware of the State Fair Hearing processand hasonly received a few 
requests fora State Fair Hearing. They reported that in the past yeartwo formal 
requests were received by the Grievance and Appeals Coordinator and four 
were received by the Health Plan Administrator. They were handled according 
to approved policy. Tracking occurs with the Grievance and Appeals 
Coordinator, and isreviewed by the Quality Assessment and Improvement 
Committee. Corrective action within the health plan occursasnecessary asthe 
result of review of the grevancesand appeals received. If the situation 
concemsa provider, a corrective action plan is put in place and appropriate 


monitoring occurs. 


Case Managers were aware of the health plan’sgnevance and appeals 
process. They related that they are often contacted when an authorization is 
denied and the member receives this information in writing. They then coach 
the member about the processand on furtheravailable actions. They also 
attempt to provide an explanation of the decision. The case managers 
advocate forthe members through this process, including directly contacting 
the Medical Director for further input and assistance in the decision review. The 
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case managers report that they do receive information forthe Grievance and 
Appeal Coordinator about the outcomes, and further action required by the 


health plan members they serve. 


Mercy CarePlus has worked diligently to improve their intemal processes and 
practicesto establish a system that is efficient and responsive to both members 
and providers. At the time of the on-site review, the current Grievance System, 
policy, and information tracking all appeared to be working efficiently. It 


appearsthat significant improvement has occured in their processes. 
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The rating forthe Grievance System (100%) reflects approval of the majority of 
policy and procedures required to meet MO HealthNet Managed Care contract 
requirements and federal policy. Practicesobserved at the time of the on-site 
review indicated that Mercy CarePlus was meeting all requirements of operating 


a functional Grievance System for both providersand members. 


Table 79 - Subpart F: Grievance Systems Yearly Comparison (MC P) 





MCP 
Federal Regulation 
2005 2006 2007 
438.402(a) Grievance and Appeals: General Requirements 2 2 2 
438.402(b)(1) Grievance System: Filing Requirements - Authority 2 2 2 
438.402(b)(2) Grievance System: Filing Requirements - Timing 2 2 2 
438.402(b)(3) Grievance System: Filing Requirements - Procedures 2 2 2 
438.404(a) Grievance System: Notice of Action - Language and Format 2 2 2 
438.404(b) Notice of Action: Content 2 2 2 
438.404(c) Notice of Action: Timing 2 2 2 
438.406(a) Handling of Grievances and Appeals: General Requirements 2 2 2 
438.406(b) Handling of Grievance and Appeals: Special Requirements 2 > > 
for Appeals 
438.408(a) Resolution and Notification: Basic Rule 2 2 2 
438.408(b,c) Resolution and Notification: Grievances and Appeals - 2 2 > 
Timeframes and Extensions 
438.408(d)(e) Resolution and Notification: Grievance and Appeals - 2 > > 
Format and Content of Notice 
438.408(f) Resolution and Notification: Grievances and Appeals - 2 > 2 
Requirements for State Fair Hearings 
438.410 Expedited Resolution of Appeals 2 2 
438.414 Information about the Grievance System to Providers and 2 > > 
Subcontractors 
438.416 Recordkeeping and Reporting Requirements 1 2 2 
438.420 Continuation of Benefits while Appeal/Fair Hearing Pends 2 2 2 
438.424 Effectuation of Reversed Appeal Resolutions 2 2 
Number Met 17 18 18 
Number Partially Met 1 0 0 
Number Not Met 0 0 0 
Rate Met 94.4% 100.0% 100.0% 


Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

Mercy CarePlus was 100% compliant in all areas for the first time since the EQR 
process wasinitiated. It isnoted that the health plan has made significant 
improvement in policy and procedure submission and approval in allareas. At 
the time of this review improvement in many areas of performance were 
observed. Mercy CarePlus continues their commitment to members and to 
providing healthcare servicesin an effective manner by demonstrating an 
atmosphere of respect and dignity toward members. The health plan’s efforts to 
be fully compliant in both having approved policy and verifiable approved 
practice isevidence of the efforts made during the past year. These 
improvements provided a sound foundation forcontinued efforts to make the 


changes required to maintain full compliance in the future. 


QUALITY OF CARE 

During the previous on-site review Mercy CarePlus indicated that they 
recognized the need to improve in the development of policies and procedures, 
and continue to review and upgrade their organization’s performance. They 
exhibited the outcomes of the commitment to these goals, and provided sound 
examples of the progress made during 2007. These discussions took place in the 
context of providing quality care and servicesto members. The health plan 
exhibits a distinct recognition of the importance within the organization of the 
need forclearcommunication between departments to effectively meet 
members’ service needs. Quality services at the health plan and provider levels 
were evident in the information presented. It should also be noted that this 
health plan maintains a system of regular direct contact with providers. Provider 
relations staff make regular in-person visits, at approximately six week intervals, to 
provider offices. Thisenhancesthe quality of relationships between the health 
plan and their providers, enabling them to troubleshoot, educate, and ensure 


that members receive the healthcare services they require. It isalso recognized 
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that the health plan staff that have the greatest direct contact with health plan 
members, Member Services and Case Management, are integrally aware of 
how their departments interact with and are supported by the other 

departments within the health plan structure. Thisenhancesthe staffs’ ability to 


serve members in an efficient and quality manner. 
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ACCESS TO CARE 

Mercy CarePlus did make a number of changes during the past two years to 
improve accessto care formembers. They were able to contract with a number 
of hospitals that were previously not in their network. Their provider panel has 
expanded in the availability of primary care physicians and specialists. The 
health plan instituted a method of contacting primary care physicians for 
members when members experience problems obtaining appointments. All of 
these activities, aswell asimprovements and training for Member Services staff, 
and additions in resources for Case Managers have created an atmosphere 
where assuring accessto care isan essential aspect of the Mercy CarePlus 


program. 


TIMELINESS OF C ARE 

An attention to the issue of timeliness of care wasalso evident at the health plan. 
They have improved significantly in the area of timely and complete policy 
submission. Changes and improvements of intemal processes have also made 
timely response to memberand provider issuesa prority. Timeliness of 
healthcare improved asthe result of changes and expansions within the 
organization. Both Case Managersand Member Services staff report that 
timely and adequate health care servicesare of primary importance in their 
involvement with health plan members. These staff gave concrete examples of 
making direct contact with providersto ensure that appointment and services 
were delivered ina timely manner to illustrate this as an essential value 


supported by Mercy CarePlus. 


RECOMMENDATIONS 

1. Continue to develop the atmosphere within Mercy CarePlus that motivates 
the attention to compliance with contractual requirements and federal 
regulations. A great deal of improvement was witnessed in this area. 


se Performance Management Solutions Group 588 


a A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 10 

Report of Findings - 2007 Mercy CarePlus 
Maintaining these improvements is an important factor in establishing 
continued confidence in the health plan. 

2. Continue to utilize the resources at Mercy CarePlus to complete all necessary 
policy documentation and submission to the SMA. 

3. Continue to enhance the area of quality improvement initiatives intemally 
within the organization to ensure that quality services occur formembers. 

4. Continue to support front line staff in their effortsto be primary advocates for 
members and to provide an atmosphere based on the desire to excellent 
healthcare servicesto members. 

5. Continue to utilize available data and member information in order to drive, 


change, and measure performance. 
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11.1 Performance Improvement Projects 


METHODS 
DOCUMENT REVIEW 
Missoun Care supplied the following documentation for review: 
e 2007 Increase Use of Controller Medications for Members with Persistent 
Asthma 
e 2007 Seven-Day Follow-Up After Hospitalization for Mental Illness 


INTERVIEWS 

Interviews were conducted with the project leaders foreach Performance 
Improvement Project (PIP) by the EQRO team on July 16, 2008 during the on-site 
review in the offices in Columbia, Missoun, and included the following: 


Tammy Weise - Manager, Quality Management 
Dr. Andrew Matera - Chief Medical Officer 
Brent Netemeyer- Manager, Operations 

Katie Dunne - Senior Quality Coordinator 


The interviewees shared information on the validation methods, study design, 
and findings. Technical assistance regarding study design and presentation of 
findings were provided by the EQRO. The following questions were addressed: 


Who were the staff involved in this project and what were their roles? 

e How were the topics identified? Exoand on why they are important to the 
health plan and its members. 
Disc uss the findings and how they were interpreted. 

e How were the interventions determined and why did the health plan 
choose thisapproach? 
Are these studies ongoing? 

e Discuss the effects of these interventions and how they impacted services 
to members. 

e What does Missoun Care want to study orleam from their PIPs? 
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Both of the PIPs submitted for validation were of adequate maturity to allow fora 
thorough evaluation. However, the health plan was instructed during the site 
visit that they could submit additional information that included updates to the 
outcomes of the interventions or additional data analysis. Additional information 


wasreceived forthe PIP. 


FINDINGS 

The first PIP evaluated was, “Increase Use of Controller Medications for Members 
with Persistent Asthma.” This PIP wasidentified asa clinical project. This PIP was 
designed to target improvement in a relevant area of membercare. The 
rationale forthe topic study choice was well documented in the information 
presented. The topic was justified in terms of providing sound local and national 
literature and research supporting the assertion that it would improve health 
outcomes forMO HealthNet Managed Care members. It included information 
on the population and provided a strong argument forchoosing the topic fora 
performance improvement project. The overarching goal of the project was 
clearly focused on correcting deficiencies in health care services. To 
accomplish this goal the PIP project planned to work with primary care providers 
to ensure that members had accessto appropriate controller medications, 


which could decrease the need for more invasive medical interventions. 


The study question presented was, “Will mailing primary care providers quarterly 
rosters of theirassigned members who have persistent asthma, but who are not 
on controller medications, increase the rate of members being dispensed the 
appropnate medications?’” The presentation of the study questions provided 
an understanding of the basis of the study and planned interventions. The 
question and supporting information provided confidence in the proposed 


methodology and anticipated outcomes. The wording of the question 
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continued to limit the PIP in entertaining new or expanded interventions for future 


work on this subject. 


The definitions of each indicator were linked to the study question and were 
based on specific HEDIS measures defining goals for this project. The objectives 
were cleanly identified and well-defined. The indicators were set up to improve 
treatment of members with persistent asthma. The health plan did define their 
population based on HEDIS technical specifications. Any member over two 
years of age iseligible, unless their diagnosis included emphysema or COPD. The 
PIP included a rationale for excluding these members. These members were not 
excluded to prevent delivery of additional servicesto those with special health 
Care needs. 
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The study design cleanly identified the data to be collected and the sources of 
thisdata. The study design specified the use of the HEDIS technical 
specifications asthe method for collecting data forboth the HEDIS measure 
information and the HEDISlike data. The query rules were included. The onginal 
information submitted priorto the on-site review wasdifficult to understand and 
required a more detailed explanation. The update received after the on-site 
review provided the details of how the HEDISlike data waspulled, and how they 
ensured that consistency is an essential component of their measurement 
techniques and interpretations. Time frames for collection and analysis were 
provided in enough detail to give confidence in the methodology used. An 
assumption can be made, aSa result of the onginal and updated information 
included, that the health plan will collect data in a consstent and accurate 
manner. The documentation provided adequate namative to determine that 


consistency and accuracy will be achieved. 


A prospective data analysis plan was descnibed in detail, including all planned 
analysisand a prospective look at the definition of success of the intervention. 
The plan includesthe methodology for obtaining a 95% confidence level in all 
data obtained and evaluated. Information on staff involved, their roles, and 
qualifications was not onginally included in any detail. In the updated 
information a detailed description was included of each member of the PIP 


team, their roles, and their qualifications. 


The planned interventions were described in enough detail to ensure a thorough 
understanding of the rationale presented, and to create confidence in the 
expected outcomesto be achieved by this study. The enhanced nanative did 
lack discussion regarding the bamiers that may be experienced in complying 
with physician orders, and other variablesthat may impact member behavior. 
The study narative did include a baseline data measurement and results for the 


first re-mea surement phase of the project. Additional results forthe third year 
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were provided. These resultsindicated a significant increase compared to the 
baseline statistics. The results in most cases did not reach the benchmark set by 
HEDIS in 2006, but the 2007 rates achieved surpassed the HEDSI 2007 rates. All of 
this information is based on acceptable HEDIS rates forthe measures involved. 
The data included did provide confidence that the interventions being 
employed were having a positive impact of the quality of care received by 
members. The narrative states that “to date this performance improvement 
project has proven to be an effective means to improving the rate of members 
with persistent asthma who receive a controller medication.” The data provided 
and all information included doessupport this assertion. The health plan plansto 
continue these educational efforts, and other interventions that are designed to 
improve outcomes for members with asthma indicators. The updated submission 
verifies sustained statistical increasesin the ratesachieved. Due to thisimproved 
performance the health plan is incorporating the PIP activities into routine plan 


practices. 


The second PIP evaluated was “Post Mental Health Hospitalization Follow-Up 
Care within Seven Days of Discharge.” This isa non-clinical study. The study topic 
was chosen to improve the rate of outpatient follow-up care after hospitalization 
for mental illness. The health plan used their current HEDIS performance rates 
compared to the NCQA benchmarks and MO HealthNet’s required reporting on 
this measure asan additional justification to initiate a performance improvement 
project. The documentation presented a thorough discussion of the rationale for 
selecting this study topic including a literature review of information from both 
localand national sources. The health plan initiated this performance 
improvement project in 2005 to implement case and care management 
activities to increase compliance with recommended outpatient treatment 
following hospitalization for mental health treatment for their members. They 
expanded this PIP in J anuary 2006 to increase the rate of follow-up appointments 


within seven days of discharge in an increased effort to ensure that members 
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obtain necessary outpatient follow up care. The information provided 

supporting the selection of thistopic included a literature review and a sound 
argument for implementing this project. The interventions planned were open to 
all members who required hospitalization fora mental health related issue, who 
were six years of age and older. No members were excluded based on having 


special healthcare needs. 


The study question presented was “Doesthe implementation of case 
management and care management activities increase the percentage of 
members who receive an aftercare appointment within seven (7) days of 
discharge from a mental health hospitalization stay?” The study question was 
well constructed and did not limit future expansion of the PIP if additional 


interventions become necessary. 
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The study used well operationalized indicators based on the requirements of the 
HEDIS measures. The indicators were clearly tied to the issues addressed in this 
study. The methods prescribed to track and enumerate these measures were 
included in the narrative provided. These indicatorsdid measure specific 
outcomes that identified improved healthcare forthe members. The information 
provided in the narative supported the assertion that increased aftercare would 
lead to stronger wellness outcomes for members with mental health issues. Data 
sources Cleany identified all members who were to be included in the study. 
Exclusions included children underage six (6), members discharged to an 
inpatient treatment facility including those specific to alcohol or drug treatment, 
and children in foster care, who do not receive outpatient mental health 
services through the health plan. All MO HealthNet Members, within the 


definitions of the targeted groups, were included. 


The data collection approach waswell planned to capture all required 
information to identify and provide required services to the members who were 
part of the study population. The narrative clearly described how data would be 
collected and analyzed. The study described the processthe health plan will 
utilize to extract data monthly. They will use HEDIS data obtained yearly through 
an NCQA certified vendor. Administrative data will be included from the health 
plan’sQMAC system. Discharge information is gathered from the health plan’s 
case management system, with follow-up information obtained directly from 
providers. The narative included enough specificity to ensure confidence that 
this process wasthorough and complete. A prospective data analysis plan was 
presented. Itincluded a plan for ensuring that attention to all issues were 
addressed, and also explained the service methodology to be employed. It 
outlined a plan to compare subsequent year's data to the 2006 baseline 
statistics. Statistical calculationsto produce the 95%confidence level 
calculated in the HEDIS methodology will be used to monitor the ongoing 


process. Alldata sources were cleanly defined and the prospective data 
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analysis plan wasfollowed. The updated documentation did provide details 


about the staff who are involved in this project, their roles, and qualifications. 


There were specific interventions identified in the narrative. How these 
interventions were related to the topic and study question wasevident. The 
primary interventions described focused on contact with discharge planners and 
members and facilitating communication on follow-up care. Each member 
discharged from hospitalization, asthe result of a mental health disorder is 
contacted by the Behavioral Health Case Manager. Appointment information is 
verified and the need fortransportation assistance is assessed. Case 
management assistance is provided if the prescheduled appointment will not be 
attainable forthe member. Additional follow-up with the provider occurs to 
ensure that appointment compliance occured. Additional contact occurs to 


reschedule if necessary. 


Data analysis was not complete at the time of the review, although it did include 
2006 the baseline year and 2007 data, which was first measurement year. The 
results were presented numerically and were explained in the narrative provided. 
Confidence intervalsand planning for identification of “real” improvement is 
part of the PIP documentation provided. The plan for subsequent year 
comparisons was provided. Additional information provided following the on-site 
review indicates that preliminary monthly data showsa significant increase from 
the 2006 rates. 


This PIP was well-constructed. It hasmatured to a level where a detailed 
evaluation can occur. The data evaluated provided a high potential for positive 
performance improvement. The plan included information on additional 
strategies for the 2008 measurement year. The analysis was planned and the 
documentation provided confidence that continued efforts on this project will 


be completed asdescribed. The information provided included additional 
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statistics for thirty (30) day follow-up even though this wasnot an onginal part of 
the study. The format and presentation led to ease in evaluating the project. 
Information was Clear, organized, and understandable, all adding to the 
confidence in the potential outcomes. This project providesan excellent 
example of constructing and tracking performance improvements in making a 
significant change in organizational operationsin an effort to improve member 


servicesand outcomes. 
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CONCLUSIONS 


QUALITY OF CARE 

The issue of quality wasa primary focus of the two PIPs undertaken by this health 
plan. The quality of healthcare, and the overarching issue of the quality of life of 
health plan members, were both addressed in these PIPs. Enacting measures to 
improve accessto primary preventive care, and assisting members in obtaining 
mental health servicesin an outpatient setting, enhancesthe quality of services 
received by these members. In both projects the health plan stated their 
planned intention to incomorate these interventions into normal daily operations 
asthe data indicated positive outcomes. Undertaking performance 
improvement projects that will develop into enhanced service provisions for 


members indicatesa commitment to quality service delivery. 


ACCESS T0 CARE 

The study topics presented in these PIPS addressed issues that will create 
improved servicesand enhance accessto care forthe health plan members. 
Although each PIP approached their respective problems differently, each 
created a potential forimproved accessto appropnate services, in the least 


restrictive environment. 


TIMELINESS OF C ARE 

The major focus of these performance improvement projects was ensuring that 
members had timely accessto care. By implementing strategiesto ensure that 
members improve their use of outpatient treatment services within the seven-day 
timeframes of follow up after hospitalization for mental health treatment, the 
health plan positively impacts timely accessto care. The project indicatesthat 
the health plan hasa commitment to assisting members in engaging in timely 
treatment. The project focusing on increasing the use of appropnate asthma 
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medications also provides members with opportunities to obtain the most 
appropriate service in the most appropnate setting. By working with providersto 
encourage patients to make timely appointments it enables better health care 


outcomes. 


RECOMMENDATIONS 
1. Continue to utilize the protocolsto develop and evaluate performance 
improvement studies. The quality of the studies submitted hasimproved 
significantly. Both studies provide evidence that there wasa great deal of 
thought and consideration put into planning these studies, developing 
appropnate interventions, and creating a positive environment for the 
potential outcomes. This process will also ensure that asthe studiesare 


completed, effective data collection and analysis will occur. 


2. Consider all interventions that may affect the projected outcomes. Ensure 
that there isadequate documentation to explain the impact of the 


interventions on the findings and outcomes. 
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11.2 Validation of Performance Measures 


METHODS 

Objectives, technical methods, and procedures are described underseparate 
cover. Thissection describes the documents, data, and persons interviewed for 
the Validation of Performance Measures for Missouri Care. Missoun Care 
submitted the requested documents on J anuary 28, 2008. The EQRO reviewed 
documentation between J anuary 28, 2008 and J uly 1, 2008. On-site review time 
wasused to conduct follow-up questions and provide feedback and 


recommendations regarding the performance measure rate calculation. 


DOCUMENT REVIEW 

The following are the documents reviewed by the EQRO: 
e The Baseline Assessment Tool (BAT) submitted by Missour Care 
e MEDSTATSNCQA HEDIS Compliance Audit Report for 2007 
e Missoun Care’s HEDIS Data Entry Training Manual 


e Missouri Care’s Policies pertaining to HEDIS rate calculation and reporting 


The following are the data files submitted for review by the EQRO: 

e ADV _Filel MoCare.txt 

e ADV _File2 MoCare.txt 

e AWC_FILE1 MoCare.txt 

e AWC _File2 MoCare.txt 

e AWC _File3 MoCare.txt 

e FUH_FILE1 MoCare.txt 

e FUH_FILE2.txt 
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INTERVIEWS 

The EQRO conducted on-site interviews with Katie Dunne, Senior Quality 
Coordinatorand Tammy Weise, Manager, Quality Management at Missoun Care 
Health Plan in Columbia, MO on Wednesday, J uly 16, 2008. This group was 
responsible forthe process of calculating the HEDIS 2007 performance measures. 
The objective of the on-site visit was to verify the methods and processes behind 
the calculation of the three HEDIS performance measures. Thisincluded both 
manual and automatic processes of information collection, storing, analyzing 


and reporting. 


FINDINGS 
Missoun Care calculated the Follow-Up After Hospitalization for Mental Illness and 
Annual Dental Visit measures using the Hybrid Method. The administrative 


method wasused to calculate the Adolescent Well-C are Visits measure. 


MO HealthNet Managed Care health plan to MO HealthNet Managed Care 
health plan comparisons of the rates of Adolescent Well-Care Visits, Follow-Up 
After Hospitalization for Mental Illness, and Annual Dental Visit measures were 
conducted using two-tailed ztests. For comparisons that were statistic ally 
significant at the 95% confidence interval (Cl), the z-score (z), the upperand 


lowerconfidence intervals (Cl), and the significance levels (p <.05) are reported. 


The HEDIS 2007 rate for Missouri Care forthe Adolescent Well-Care Visits measure 
was 44.91%, which was significantly higher than the statewide rate forall MO 
HealthNet Managed Care Health Plans (34.81%; z =-0.33, 95% CI: 28.89%, 40.74%; 
p >.95). This rate wasalso higherthan the rate (41.19%) reported by the health 
plan during the 2004 Extema! Quality Review. 


The Follow-Up After Hospitalization for Mental Illness measure is reported as two 
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rates, one for 7-day follow-up and one for 30-day follow-up. The Follow-Up After 
Hospitalization rates reported to the SMA and the State Public Health Agency 
(SPHA) by Missoun Care were 42.58% (7-day rate) and 63.16% (30-day rate). The 
7-day rate reported wasconsistent with the statewide rate forall MO HealthNet 
Managed Care Health Plans (35.52%; z =-0.34, 95% Cl: 22.96%, 48.08%; n.s.); 
however, this rate wasa vast improvement over the 7 day rate (17.65%) reported 
by the health plan during the 2006 review. The 30-day rate reported was 
significantly higher than the statewide rate forall MO HealthNet Managed Care 
Health Plans (60.06%; z =1.38, 95% Cl: 47.50%, 72.62%; p >.95) and wasalso 
higher than the 30 day rate (47.79%) reported by the health plan during the 2006 


review. 


The reported rate for Missoun Care forthe Annual Dental Visit rate was 27.76% 
significantly lowerthan the statewide rate forMO HealthNet Managed Care 
Health Plans (32.50%, z =0.04; 95% Cl: 29.30%, 35.69%; p <.05); this rate is also 
lower than the rate (28.66%) reported by the health plan during the 2005 review. 


The following sections summarize the findings of the process for validating each 
of the performance measures in accordance with the Validating Performance 
Measures Protocol. The findings from all review activities are presented 
according to the EQRO validation activity, with the findings foreach measure 
discussed within the activitiesasappropnate. Please referto the tablesin the 
main report for activities, ratings, and comments related to the CMS Protocol 


Attachments. 


DATA INTEGRATION AND CONTROL 
The information systems (IS) management policiesand procedures for rate 
calculation were evaluated consistent with the Validating Performance 


Measures Protocol. Forall three measures, Missourn Care was found to meet all 
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criteria for producing complete and accurate data (see Attachment V: Data 
Integration and Control Findings). There were no biases oremors found in the 
manner in which Missoun Care transferred data into the repository used for 


Calculating the HEDIS 2007 measures. 


DOCUMENTATION OF DATA AND PROCESSES 

Missouri Care used Catalyst, an NCQA-certified software program in the 
calculation of the HEDIS 2007 performance measures. The EQRO wasprovided a 
demonstration of this software, aswell as appropriate documentation of the 
processesand methodsused by this software package in the calculation of 
rates. The EQRO wasalso provided with an overview of the data flow and 
integration mechanisms for extemal databases forthese measures. Data and 
processes used forthe calculation of measures were adequate (see Attachment 
Vil: Data and Processes Used to Calculate and Report Performance Measures). 


Missouri Care met all criteria that applied forall three measures. 


PROCESSES USED TO PRODUCE DENOMINATORS 

Missourn Care met all criteria forthe processes employed to produce the 
denominators of all three performance measures (see Attachment X: 
Denominator Validation Findings). Thisinvolved the selection of members eligible 
forthe services being measured. 

Missoun Care employed a 5%oversample forthe Adolescent Well-Care Visits 
measure. No records were excluded for contraindic ations, making fora total 
sample of 432. Thisis within the specified range and allowable methods for 


propersampling. 


For the HEDIS 2007 Adolescent Well-Care Visits measure, there were a total of 
5,376 eligible members listed by the health plan and validated by the EQRO. The 
DSTshowed a denominator of 432 eligible members after a 5% oversample. 
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There were no exclusions allowed forthe measure, and no exclusions or 
replacements reported. There were no duplicate member names, identification 
numbers or dates of birth. The datesof birth were within the valid range and the 


dates of enrollment and codes for well care visits were provided. 


For the HEDIS 2007 Follow-Up After Hospitalization measure, the DSTshowed a 
total of 209 eligible members forthe denominator. The file of all administrative 
recordssupplied by the health plan contained 209 eligible members. There was 
no duplication of members and the dates of birth and dates of enrollment were 


within the valid range. 


For the HEDIS 2007 Annual Dental Visit measure, there were a total of 14,945 
eligible members reported and validated by the EQRO. There were no duplicate 


members and the datesof birth were in the valid range. The dates of enrollment 


were valid. 
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PROC ESSES USED TO PRODUCE NUMERATORS 

All three measuresincluded the appropnate data ranges for the qualifying 
events (e.g., well-care visits, follow-up visits, and dental visits) as specified by the 
HEDIS 2007 criteria (see Attachment XiIll: Numerator Validation Findings). A 
medical record reviews wasconducted for the Adolescent Well-Care Visit 


measure. 


Forthe Adolescent Well-Care Visit measure, Missoun Care reported 158 
administrative hits from the sample of the eligible population; the EQRO 
validated all 158 of these hits. Forthe medical record review validation, the 
EQRO requested 30 records. A total of 30 records were received for review, and 
all 30 of those were validated by the EQRO. Therefore, the percentage of 
medical records validated by the EQRO was100.00% The rate calculated by 
the EQRO based on validated administrative and hybrid hits was 44.91%, which is 


the same rate reported by the health plan. Therefore, no bias was found. 


For the HEDIS 2007 Follow-Up After Hospitalization measure, the health plan 
reported 89 administrative hits from the eligible population for the 7-day follow- 
up rate; the EQRO validated all 89 of these hits. The health plan reported 132 
administrative hits from the eligible population forthe 30-day follow-up rate; the 
EQRO validated 131 administrative hits. The reported 7-day rate was 42.58%, and 
the rate validated by the EQRO wasthe same, resulting in no biasfound. The 
rate reported forthe 30-day calculation was 63.16%, with the EQRO validating a 


rate of 62.68%. This represents an overestimate reported bias of 0.48%. 


For the HEDIS 2007 Annual Dental Visit measure, the EQRO validated 4,137 of the 
4,149 reported administrative hits. The health plan’s reported rate was 27.76% 
and the EQRO validated rate was 27.68%, resulting in a bias (overestimate by the 
health plan) of 0.08%. 
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SAMPLING PROCEDURES FOR HYBRID METHODS 
The Hybrid Method wasused for the Adolescent Well-Care Visits measure. CMS 
Protocol Attachment XIl; Impact of Medical Record Review Findings and 


Attachment XV: Sampling Validation Findings were completed for this measure. 


SUBMISSION OF MEASURES TO THE STATE 

Missouri Care submitted the DSTfor each of the three measures validated to the 
SPHA (the Missoun Department of Health and Senior Servic es; DHSS) in 
accordance with the Code of State Regulations (19 CSR § 10-5.010 Monitoring 
Health Maintenance Organizations) and the SMA Quality Improvement Strategy. 


DETERMINATION OF VALIDATION FINDINGS AND CALCULATION OF BIAS 

The following table shows the estimated bias and the direction of bias found by 
the EQRO. There wasno bias observed in calculation of the Adolesc ent Well- 
Care Visits and 7-day Follow-Up After Hospitalization measures. The 30-day 
Follow-Up After Hospitalization and Annual Dental Visit measures were slightly 
overestimated, but these results still fell within the 95% confidence interval 


reported by the health plan for these measures. 


Table 80 - Estimate of Bias in Reporting of MOC are HEDIS 2007 Measures 


Direction of 
Estimate of Bias | Estimate 
Adolescent Well-C are Visits No bias n/a 


Follow- Up After Hospitalization (7 days) No bias n/a 
Follow-Up After Hospitalization (30 days) 0.48% Overestimate 
Annual Dental Visit 0.08% Overestimate 





FINAL AUDIT RATING 


Performance Management Solutions Group 610 
eee A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 11 
Report of Findings - 2007 Missoun Care 
The Final Audit Rating foreach of the performance measures was based on the 
findings from all data sources that were summarized in the Final Performance 
Measure Validation Worksheet foreach measure. The table below summarizes 
Final Audit Ratings based on the Attachments and validation of numerators and 


denominators. 
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Table 81 - Final Audit Rating for MOCare Performance Measures 





Final Audit Rating 

Adolescent Well-Care Visits Fully Compliant 

Follow- Up After Hospitalization (7 days) Fully Compliant 

Follow-Up After Hospitalization (30 days) Substantially Compliant 

Annual Dental Visit Substantially Compliant 
Note: Fully Compliant =Measure was fully compliant with State specifications; Substantially 
Compliant =Measure was substantially compliant with State specifications and had only minor 
deviations that did not significantly biasthe reported rate; A significant biasin the rate was defined 
asa numbercalculated by the EQRO that fell outside the 95% confidence interval of the rate 
reported by the health plan. Not Valid =Measure deviated from State specifications such that the 
reported rate wassignificantly biased. Thisdesignation is also assigned to measures for which no 
rate wasreported; Not Applicable =No MO HealthNet Managed Care Members qualified forthe 
measure. 





CONCLUSIONS 

Four rates were validated forthe health plan. One of these rateswas 
significantly lower; one wasconsistent with; and two were significantly higher 
than the average forall MO HealthNet Managed Care Health Plans. 


QUALITY OF CARE 

Missoun Care’s calculation of the HEDIS 2007 Follow-Up After Hospitalization for 
Mental Illness measure was either fully compliant (7-day calculation) or 
substantially complaint (30-day calculation) with specifications. This measure is 
categorized asan Effectiveness of Care measure and isdesigned to measure 
the effectiveness quality of care delivered. The health plan’s 7-day follow-up 
rate for this measure was Significantly lower than the average forall MO 
HealthNet Managed Care Health Plans. The health plan’s 30-day follow-up rate 
for this measure was significantly higher than the average forall MO HealthNet 
Managed Care Health Plans. Therefore, Missouri Care’s membersare receiving 
the quality of care forthis measure that is lower than the average MO HealthNet 
Managed Care Health Plan member within the 7-day timeframe, but higher than 
the average member within the 30-day timeframe. However, both of these rates 


were higher than the National Medicaid rate, indicating that Missouri Care’s 
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membersare receiving a higher quality of care for this measure than the 
average Medicaid member acrossthe nation. Both of these rates were also 
higher than the rates reported by the health plan during the 2006 review, 
thereby indicating that Missoun Care members were receiving a higher quality of 
care forthe HEDIS 2007 measurement year than they were during the HEDIS 2006 


measurement year. 


Performance Management Solutions Group 613 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Section 11 
Report of Findings - 2007 Missoun Care 
The EQRO wasable to validate the 7-day rate fully and therefore is extremely 
confident in the calculated rate. The 30-day rate wasable to be validated 
within the reported 95% confidence intervalsand thereby the EQRO has 


substantial confidence in the calculated rate. 


ACCESS TO CARE 

The HEDIS 2007 Annual Dental Measure for Missouri Care was substantially 
compliant with specifications; this measure is categorized asan Effectiveness of 
Care measure. Because only one visit is required fora positive “hit”, this measure 
effectively demonstrates the level of accessto care that members are receiving. 
The rate reported by the health plan for this measure was significantly lower than 
the average forall MO HealthNet Managed Care Health Plans. Therefore, 
Missourn Care’s members are receiving a quality of care for this measure that is 
lower than the average MO HealthNet Managed Care member. Additionally, 
this rate was lowerthan the same rate reported by the health plan during the 
2005 review, indicating that Missourn Care membersare receiving lower quality of 
care for this measure than their counterparts were during the HEDIS 2005 


measurement year. 


This rate was able to be validated within the reported 95% confidence intervals 


and therefore the EQRO has substantial confidence in the calculated rate. 


TIMELINESS OF C ARE 

The health plan’s calculation of the HEDIS 2007 Adolescent Well-Care Visits 
measure was fully compliant with specifications. This measure iscategorized asa 
Use of Services measure and is designed to measure accessto and timeliness of 
the care defined. The health plan’s reported rate for this measure was 
significantly higherthan with the average forall MO HealthNet Managed Care 
Health Plans. This rate wasalso higher than the rate reported by the health plan 
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during the 2004 review. Therefore, Missoun Care’smembersare receiving a 
higher timeliness of care for this measure than the care delivered to the average 
MO HealthNet Managed Care member. Additionally, the reported rate was 
higher than both the National Medicaid Rate and the National Commercial 
Rate; Missoun Care isdelivering a higher level of care than that received by the 


average Medicaid orCommercial member across the nation. 
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The EQRO wasable to fully validate this rate and thereby hasextreme 
confidence in the calculated rate. 


RECOMMENDATIONS 

1. The health plan’s Follow-Up After Hospitalization Rate (7 day follow-up) 
was significantly lowerthan the average rate forall MO HealthNet 
Managed Care Health Plans. The EQRO recommends the health plan 
concentrate efforts to improve this rate. 

2. Continue to conduct and document statistical comparisons on rates from 
yearto year. 

3. Continue to participate in training of health plan staff involved in the 
oversight of coordination of performance measure calculation. 

4. Continue to perfom hybrid measurement on those measures that are 
available forthis method of calculation. The Adolescent Well-Care 
measure rate was significantly higher than those health plans that did not 


use the hybrid methodology. 
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11.3 Validation of Enc ounter Data 


FINDINGS 

The findings for the encounter data validation are organized according to the 
encounter data evaluation questions presented in the Technical Methods 
section forthe encounter data validation in the aggregate report. Please refer 
to the main report for detailed objectives, technical methods and procedures for 


encounter data validation. 


What is the Baseline Level of Completeness, Accuracy, and Reasonableness of 
the Critical Fields? 


Forthe Medical claim type, there were 80,857 encounter claims paid by the SMA 

forthe period J uly 1, 2007 through September 30, 2007. 

1. The Outpatient Claim Type field was 100.00% complete, accurate and valid. 

2. The Outpatient Recipient ID field was 100.00% complete, accurate and valid. 

3. The Outpatient First Date of Service field was 100.00% complete, accurate 
and valid. 

4. The Outpatient Last Date of Service field was 100.00% complete, accurate 
and valid. 

5. The Outpatient Units of Service field was 100.00% complete, accurate and 
valid. 

6. The Outpatient Procedure Code field was 100.0% complete, accurate and 
valid. 

7. The Outpatient Place of Service field was 100.00% complete, accurate and 
valid. 

8. The first Diagnosis Code field was 100.00% complete, accurate and valid. 

9. Although the second through fifth Diagnosis Code fields are optional 
according to the Health Plan Record Layout Manual, the second, third, fourth 
and fifth Diagnosis Code fields were well below the SMA threshold of 100.00% 
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for completeness, accuracy and validity. The Diagnosis Code fields were 
49.16%, 23.35%, 11.38%, and 0.00% complete, accurate and valid, 
respectively. The remaining fields were blank (incomplete, inaccurate and 


invalid). 


For the Dental claim type, there were 9,856 encounter claims paid by the SMA 
forthe period J uly 1, 2007 through September 30, 2007. All fields examined 


excluding the first and fifth Diagnosis fields were 100.00% complete, accurate 


and valid. 
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Forthe Home Health claim type, there were no encounterclaims paid by the 
SMA forthe period J uly 1, 2007 through September 30, 2007. 


For the Inpatient claim type, there were 10,491 encounter claims paid by the 
SMA forthe period J uly 1, 2007 through September 30, 2007. 

The Inpatient Claim Type field was 100.00% complete, accurate and valid. 
The Recipient ID field was 100.00% complete, accurate and valid. 

The Admission Type field was 100.00% complete, accurate and valid. 

The Admission Date field was 100.00% complete and accurate, and valid. 
The Discharge Date field was 100.00% complete, accurate and valid. 

The Bill Type field was 100.00% complete, accurate and valid. 

The Patient Status field was 100.00% complete, accurate and valid. 

The first Diagnosis Code field was 100.0% complete, accurate and valid. 
The second, third, fourth and fifth Diagnosis Code fields fell well below the 
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100% threshold for completeness, accuracy, and validity established by the 
SMA (92.0%, 76.73%, 58.58%, and 45.80% respectively). The remaining fields 
were blank (incomplete, inaccurate, and invalid). 
10. The First Date of Service field was 100.00% complete, accurate and valid. 
11. The Last Date of Service field was 100.00% complete, accurate and valid. 
12. The Revenue Code field was 99.99% complete, accurate, and valid. Two 
fields were blank (incomplete, inaccurate, and invalid). 


13. The Units of Service field was 100.00% complete, accurate and valid. 


Forthe Outpatient Hospital claim type, there were 60,184 encounter claims paid 

by the SMA forthe period J uly 1, 2007 through September 30, 2007. Missouri Care 

had 100.00% complete, accurate and valid data forall fields examined, except 

the Procedure Code, second, third, fourth and fifth Diagnosis Codes. 

1. The Procedure Code field was 97.34% complete and accurate, The 
remaining fields (n=2026) were blank. The Procedure Code field was 78.59% 


valid. The remaining fields were blank (n=2026) or contained invalid codes 
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(n=10,858). 

2. The second Diagnoss Code field was 52.90% complete, accurate, and valid. 
The remaining fields were blank (n =28,834). 

3. The third Diagnosis Code field was 25.53% complete, accurate and valid. The 
remaining fields were blank (incomplete, inaccurate, and invalid). 

4. The fourth Diagnosis Code field was 12.08% complete, accurate, and valid. 
The remaining Diagnosis Code fields were blank (n =52,916). 

5. The fifth Diagnosis Code field was6.17% complete, accurate and valid. All 
remaining Diagnosis Code fields were blank (incomplete, inaccurate, and 


invalid). 


Forthe Pharmacy claim type, there were 53,084 claims paid by the SMA forthe 
period J uly 1, 2007 through September 30, 2007. Missouri Care had 100.00% 


complete, accurate and valid data forall fields examined. 


What Types of Encounter Claim Data are Missing and Why? 

Based on the above analysis of the accuracy, completeness, and validity of the 
data in the SMA encounter claims extract file for Missour Care, an error analysis 
of the invalid entnes was conducted for fields which were lower than the 100.00% 
threshold specified by the SMA. All critical fields for the Inpatient, Outpatient 
Medical, Dental and Pharmacy claim types were 100.00% complete, accurate, 
and valid (see previous findings). The Outpatient Hospital Claim type had invalid 


data in the Procedure Code fields. 


What is the Level of Volume and Consistenc y of Servic es? 

When companing the rate of encounter claim types per 1,000 members, the 
rates for Outpatient Hospital claim types were significantly higher than the 
average forMO Health Net Managed Care Health Plans. The rates forall other 
claim types were consistent with the average forMO HealthNet Managed Care 
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Health Plans. This suggests high rates of encounter data submission and access 
to preventive and acute care. 
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To What Extent do the Claims in the State Encounter Claims Database Reflect the 
Information Doc umented in the Medical Record? Whatis the Fault/ Match Rate 
between State Encounter Claims and Medical Records? 


To examine the degree of match between the SMA encounter claims database 
and the medical record, 100 encounters from each MO HealthNet Managed 
Care Health Plan were randomly selected from all claim types for the period J uly 
1, 2007 through September 30, 2007for medical record review. 


Of the 214,472 encounter claim typesin the SMA extract file forJ uly 1, 2007 
through September 30, 2007, 100 encounters were randomly selected. Providers 
were requested to submit medical records for review. There were 98 medical 
records (98.0%) submitted forreview. Encounters for which no documentation 
was submitted were unable to be validated. The match rate for procedures was 
58..0%, with a fault rate of 42.0% The match rate for diagnoses was 60.0%, with a 
fault rate of 40.0% 


What Types of Errors Were Noted? 
An eror analysis of the errors found in the medical record review for procedure, 
diagnosis, name of drug dispensed, and quantity of drug dispensed was 


conducted. 


Forthe procedure codesin the medical record, the reasons for procedure codes 
in the SMA extract file not being supported by documentation in the medical 
record were missing information (n =42). Forthe diagnosis codes in the medical 
record, the reasons for diagnosis codes in the SMA extract file not being 
supported by documentation in the medical record was missing information (n = 
40). Examples of missing information include no code; codes listed that were not 


supported, orcodesthat did not match the procedure description. 
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To what extent do the MO HealthNet MC HP paid/ unpaid enc ounter claims match 
the SMA paid database? 

Since Missouri Care included intemal control numbers that matched those of the 
SMA, the EQRO conducted the planned analyses comparing MO HealthNet 
Managed Care Health Plan encounter data to the SMA encounter claim extract 
file. The SMA defined “unpaid claims” asthose claims that the health plan 


denied for payment, unpaid claims do not include claims paid via a capitation 





plan. 


Forthe Phamacy Claim type, all encounterdata submitted to the EQRO wasof 
“paid” status. There were zero unmatched claimsthat were in the MOCare 
encounter file and absent from the SMA data. Thus, 100.0% of the EQRO 


submitted encounters matched with the SMA encounter records. 


For all Outpatient Claim Types (Medical, Dental, and Hospital), MOCare 
submitted 150,897 “paid” encounters, 163 “denied” claimsand one “unpaid” 
claim. All paid encounter claims matched with the SMA encounter claim extract 
file. The 163 denied claims and 1 unpaid claim were not present in the SMA 
database (as expected); there wasa “hit” rate of 99.89% between MOCare 


encounter claims and the SMA encounter data. 


Forthe Inpatient Claim Type, MOCare submitted 10,491 encounter claims of 
“paid” sttatusand 17 “denied” claims. All paid encounterclaims matched with 
the SMA encounter claim extract file. The denied claims were not present in the 
SMA database. 


Why are there unmatched claims between the MO HealthNet Managed Care 
Health Plan and SMA data files? 


The unmatched encounters are due to missing ICN numbers which are required 


to match the encounterto that of the SMA. Therefore, in all claim types, the 
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encounter claims were legitimately missing from the SMA extract data. 
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What are the Data Quality Issues Associated with the Processing of Enc ounter 
Data? 

While the MO HealthNet Managed Care Health Plan did submit the data in the 
requested format (including most ICN numbers), there are a numberof ways to 
improve the data quality by improving the database system. Asthe Intemal 
Control Numberis only assigned by the State database when a claim is paid, it is 
difficult to match the health plan data of “unpaid” and “denied” claimsto the 
SMA data. Asthe Intemal Control Numberis unique only to the encounter, the 
ICN may be represented in multiple lines of data. To match the MO HealthNet 
Managed Care Health Plan data to the SMA data to specific fields, this requires 
a unique line number. Therefore each service provided within an encounter 


would have a separate line of data with a unique line identifier. 


CONCLUSIONS 
STRENGTHS 

1. Encounterdata wassubmitted to the EQRO in the requested format and 
even included intemal control numbers which enabled BHC to conduct 
the planned companions between the MO HealthNet Managed Care 
Health Plan and the SMA extract files. 

2. The critical field validation of all six claim types resulted in few fields under 
the SMA established threshold of 100.00% accuracy, completeness, and 
validity. 

3. The critical fields examined for the Dental, Outpatient Medical, and 
Pharmacy claim types were 100.00% complete, accurate and valid. 

4. The rates for Outpatient Hospital claims were significantly higher than the 
average forMO HealthNet Managed Care Health Plans, suggesting high 
rates of encounter data submission and at least moderate accessto 


preventive and acute care. 
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AREAS FOR IMPROVEMENT 

1. The Inpatient Revenue Code fields contained invalid (blank) entries. 

2. The Outpatient Procedure Code fields contained invalid entries. 

3. The health plan reported no Home Health encounter claims during the review 


period. 


RECOMMENDATIONS 

1. Examine and revise asneeded intemal system edits for invalid procedure 
codes in the NSF/CMS 1500 file layout forthe Outpatient Procedure Code 
and run validity checks after the programming of new edits. 

2. Ensure that Revenue Code fieldsare complete and valid forthe Inpatient 
(UB-92) claim types, and institute error checks to identify invalid data. 

3. Include all State issued ICN numbers forall encounters to allow more 
accurate matching of encounters between the MO HealthNet Managed 
Care Health Plan and SMA extract files. 


<a Performance Management Solutions Group 626 
ee A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Section 11 


Report of Findings - 2007 Missoun Care 


11.4 MO HealthNet MC HP Compliance with Managed 
Care Regulations 


METHODS 

Priorto the site visit, documentation was received and reviewed regarding the 
MO HealthNet Managed Care Health Plan’s compliance with the State 
contract. The Extemal Quality Review Organization (EQRO) reviewed contract 
documents with the staff of the MO HealthNet Division (MHD). On-site review 
time was used to conduct interviews with those who oversee and conduct the 
daily activities of the health plan to ensure that documentation is developed 
and practicesoccur within the scope of the contract and ina manner that 


meets or exc eeds federal regulations. 


A detailed protocol (BHC MO HealthNet Managed Care Health Plan 
Compliance Review Scoring Form) wasutilized to ensure that all the elements of 
the federal regulations were addressed in the review process. Additionally, an 
interview tool was constructed to validate practices that occur at the health 
plan and to follow-up on questions raised from the document review and from 
the 2006 Extemal Quality Review. Document reviews occurred on-site to 
validate that practicesand procedures were in place to guide organizational 


performance. 


DOCUMENT REVIEW 
The Division of Medical Services supplied: 
e State of Missouri Contract Compliance Tool (including DMS responses and 


comments) 
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The following documents were requested for on-site review: 


Member Handbook 

Provider Handbook 

Policy Tracking Log 

Staff Training Log 

Credentialing Policies and Audit Reports 
Grievance Logs (Memberand Providers) 


2007 Annual Quality Improvement Program Evaluation 


Additional documentation made available by Missoun Care Health Plan 


included: 


Marketing Plan and Educational Material Development Policy 
2007 Marketing Materials 

Missoun Care Organizational Chart 

Missouri Care Provider Directory 


Missoun Care Informational Handouts 


INTERVIEWS 


Interviews were conducted with the following groups: 


Plan Administration 





Pamela J ohnson, Executive Director 

Dr. Andrew Matera, Chief Medical Officer 
Melody Dowling, UM Manager 

Tammy Weise, Manager, Quality Management 
Brenda Moore, Manager, Medical Management 
Debby Langley, Manager, Member Solutions 
Brent Netemeyer, Director, Operations 


Katie Dunne, Senior Quality Coordinator 
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Member Servic es Sta ff 

e Michelle Sandbothe, Member Services 

e Chiquita Chatmon, Member Services 


e Debby Langley, Manager, Member Solutions 


Case Management Sta ff 
e Dr. Andrew Matera, Chief Medical Officer 


e Melody Dowling, UM Manager 

e Mary Strata, Case Manager 

e Brenda Moore, Manager, Medical Management 
e Jeanette Hogan, Case Manager 


e Amanda Lucas, Case Manager 


FINDINGS 

ENROLLEE RIGHTS AND PROTECTIONS 

Missoun Care hasan assigned compliance officer who maintained a record of 
all intemal policiesand presented reminders to appropnate staff when annual 
reviews were required. Compliance reviewsare conducted every other month. 
Recordsincluded all initial approval datesto ensure that timely monthly 
reminders were produced. Revisions were made asnecessary. Intemal 
approval included the Quality Management Oversight Committee, Managers, 
the Chief Medical Director, and the Executive Director pnorto submission to the 
SMA. 


The health plan continues to utilize the Child and Adolescent Health 
Measurement Initiative (CAHMI) survey instrument formemberneeds 
assessment. Missoun Care utilized the monthly special needs listing produced by 
the SMA and sent the survey to all of their members appearing on this listing. If 


they received no response in seven days, and again in fourteen days, they 
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made additional attempts using telephone contacts. If the health plan was 
unable to contact the member after 30 days, the file wasclosed. Missoun Care 
reported they send out 75-100 CAHMIs each month and have a 30-35% response 
rate. The health plan finds that using the CAHMI assists in correctly identifying 


members who need physical ormental health case management services. 
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The health plan discussed identified dissatisfaction expressed by members with 
provider communication. This was onginally identified in the 2005 CAHPS Survey 
and the health plan continuesto monitor this issue. Missouri Care used both their 
newsletters to membersand providers to disc uss the issue of positive 
communication techniques. The health plan hasidentified a reduction in the 


complaints from members. 


Missouri Care continues to participate in community-based programs throughout 
the Central Region. They were involved in school-based health clinics whenever 
possible. They participated in a back-to-school fairs where they not only 
contacted member families directly, but were able to network with regional 
primary care physicians (PCPs). Additionally, outreach calls were made to all 
eligible children. One local Federally Qualified Health Center (FQHC) conducts 
evening appointments to do Pap testsand adolescent EPSDT examinations. Asa 
trial intervention, Missoun Care scheduled appointments forthe FQHC utilizing 
demographic information obtained from their system. Theses efforts resulted in 
additional examinations. Through efforts with the Columbia Public Schools, the 
health plan continues its targeted campaign to increase EPSDT examinations in 
the Boone County section of the region. EPSDT examinations for high school 
students were planned at the new Family Health Clinic satellite location near the 
Frederick Douglas High School building. A quarterly newsletter for school nurses 
wasdeveloped and continuesto be distributed by the health plan. 


Member Services staff report receiving training on both the federal regulations 
and MO HealthNet Managed Care contract requirements. They are also trained 
on AEINA policy, and local health plan specific policiesand procedures. These 
staff members are aware of their responsibility to contact new members and 
provide a full explanation of health care benefits that are available. The 
Member Services staff explained that non-English soeaking members were 


provided accessto the Language Line and assisted to select providers with 
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appropriate language capabilities. They also utilize staff members at the 
University of Missouri to assist with any extraordinary language issues. The 

Member Services staff viewed themselves as advocates for the health plan 
members. They give overviews of the handbook, explain benefits, problem solve 
with members, and assist members in finding providers and obtaining timely 


appointments. 
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Case Managers accept referrals from various sources including physicians, the 
enrollment broker, outreach events, the health plan’s medical director, Lutheran 
Family Services, WIC, SMA special needs information, Provider Representatives, 
Behavioral Health case managersand providers, Pror Authorization staff, 
Concurent Review Nurses, the Regional Center, and Family Support Division 
case workers. If the referral isforOB case management, the memberis 


contacted within seven to ten days. 


Case Managers discussed the process when they receive a referral. A general 
assessment is completed, followed by an assessment pertinent to any 
detectable disease process. A plan of care isdeveloped with the member. 
Needs, such astransportation or referrals to community resources, are identified 
and servicesare put in place. Children may be referred to First Steps, ora 
member may receive an additional referral to behavioral health services. All 
members identified as having special health care needsare also given the 
CAMHI Survey, which addsdepth to the assessment process. The member and 
their provider are given copiesof the member's profile. Pharmacy profiles are 
also sent to the PCP. All information is entered into the health plan’s system, 
which also allows for co-case management. Case managers make frequent 
callsto members to ensure that they participate in the care and treatment 
required. Membersare informed of their right to refuse treatment and also to 


execute an advance directive. 


The rating for Enrollee Rights and Protections (100%) reflects that the health plan 
substantially complied with the submission and approval of all policy and 
proceduresto the SMA forthe second year. All practice observed at the on-site 
review indicates that the health plan appears to be fully compliant with MO 
HealthNet Managed Care Contract requirements and federal regulations in this 


area. 
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Table 82 - Subpart C: Enrollee Rights and Protections Yearly Comparison (MOCare) 


Missouri Care 


Federal Regulation 








438.100(a) Enrollee Rights: General Rule 2 2 2 




















438.10(b) Enrollee Rights: Information Requirements 2 2 2 
438.10(c)(3) Alternative Language: Prevalent Language 2 2 2 
438.10(c)(4,5) Language and Format: Interpreter 2 2 > 
Services 

438.10(d)(1)(i) Information Requirements: Format/Easily 2 2 2 
Understood 

438.10(d)(1)(ii)and (2) Information Requirements: 2 > > 
Format Visually Impaired, and Limited Reading Proficiency 

438.10(f) Information for All Enrollees: Free Choice, etc. 2 2 2 
438.10 (g) Information to Enrollees: Specifics/Physician 2 2 2 
Incentive Plans 

438.10(i) Special Rules: Liability for Payment/Cost 2 2 2 
Sharing 

438.100(b)(2) (iii) Enrollee Rights: Provider-Enrollee 2 2 2 
Communications 

438.100(b)(2)(iv,v) Rights to Refuse Services/Advance 2 > > 
Directives 

438.100(b)(3) Right to Services 1 2 2 
438.100(d) Compliance with Other Federal/State Laws 2 2 2 
Number Met 12 13 13 
Number Partially Met 1 0 0 
Number Not Met 0 0 0 
Rate Met 92.3% 100.0% 100.0% 






Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


BEHAVIORAL HEALTH 

In 2005, through efforts with the SMA, the University of Missoun, and other State 
agencies, Missour Care made tele-psychiatry services available in six counties in 
the Central Missouri region. Thisservice continuesto be available and creates 
accessin outpatient offices for use by specialist psychiatrists. Face-to-face 
sessions with the member's behavioral health provider are required. Pediatric 
and adolescent psychiatrists are available through this method to outlying 


counties, where these services would nomally be unavailable. In some cases, 
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the parent and case manager participated in sessions with the memberand 
psychiatrist. This innovation createsa more comprehensive approach to 


treatment fora number of members. 


Missouri Care reports that provider availability hasimproved during 2006 and 
2007. There isa larger network using smaller in-home provider groups, as well as 
independent providers. The health plan believes that working directly within the 
Central Region communities, they have been able to identify and recruit mental 
health providers that are regionally based. These providersare often keenly 
aware of community and family issues that assist members in obtaining the best 
service in the most convenient environment. The health plan found that issues 
such asdrug overdosesare now treated appropnately. In the past, members 
were seen in an emergency room and released. Effortsto educate providers 
have created an atmosphere where the health plan is notified and follow-up 


servicesare putin place in an expedient manner. 


Members who require inpatient treatment are served directly by case 
management staff. Case managers assist the memberin obtaining an inpatient 
bed, and work to ensure that appropriate aftercare servicesare arranged. The 
health plan finds that overall inpatient dayshave been reduced and outpatient 


service utilization has increased. 


QUALITY ASSESSMENTAND PERFORMANCE IMPROVEMENT 

Access Standards 

New and additional specialties have been added to the Missouri Care network 
through an agreement with Kansas City Children’s Mercy Hospital during 2006. 
The MO HealthNet Managed Care Health Plan also worked with St. Louis 
Children’s Hospital to obtain an agreement. These additions have made 
orthopedic services more accessible to members. Pediatric cardiology and 
neurology are available at the University of Missoun Hospital and Clinics. Dental 
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Care continues to be a problem, and the health plan reported that they are 
moving their subcontract for dental services to Delta Dental to improve the 
availability of services. The health plan continues its recruitment efforts in this 


area. 


The health plan began using a predictive model to identify candidates forcase 
management. Thismodel, Pathways, givesa profile which helpsto identify the 
potential forcase management. Through the information obtained from this 
system, the case managercan determine the reasons for accessing care in the 
emergency room. Other categories of care explored include the providers that 
have been utilized, how much phamacy usage hasoccuned, and what 
durable medical equipment was authorized and purchased. On the daily 
patient census, a drilldown can provide reasons for admission such asmatemity, 
behavioral health verses physical health, as well as identifying the inpatient 
facility used and the length of stay. This program refreshes every three hours and 
is linked to Milliman Guidelines for utilization review purposes. A link also exists to 
review notes. Thismodel givesa quick look at member activity fora one year 
timeframe. The health plan believesthe model will be useful to both case 
management staff and providers. It will allow the Medical Directorto discussa 
case with the Primary Care Physician and will enable them to ask and resolve 


questions quickly. 


Prenatal case management continues to be a focus of the care provided to 
health plan members. The health plan staff continues to use the global OB fom, 
which includes risk factors and points to the need forcase management. 
Referrals are sometimes made to the Department of Social Services Children’s 
Division for in-home services from this information. The information also generates 
a notice when membersare identified aspregnant. The system generatesa 
packet of information, educational material for members, and notices for visits 


that can be used asincentivesto maintain scheduled appointments. 
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The Missoun Care Nurse Line call center, located in Phoenix, Arizona, is staffed 24 
hours perday, seven days perweek. Both nurse and physician coverage is 
available. Afterhours accessto local providers hasimproved. During 2006 four 
clinics were found to be out of compliance. Education and follow-up activities 
occured. Recent checks indicate that these clinics are now complying with 
after-hours requirements and are compliant. This follow-up information was 


obtained through a follow-up survey completed in Apni 2007. 


Member Services staff explains that many of theircalls concem provideraccess. 
They coordinate information with the Nurse Advice Line. The use of this line does 
generate the use of available urgent care centers, rather than inappropriate use 
of emergency rooms. Another frequent call received iscomplaints about not 
being able to access providers after hours. This information is forwarded to the 
Provider Relations department. The Member Service staff works with the health 
plan member to identify altemative providers orto identify other resources, such 
asthe Nurse Advice Line, that can assist the member during non-business hours. 
Member Services staff also contact providers directly to assist members in 
obtaining timely appointments, with prescription information, and to ensure that 
the provider has all information nec essary to serve the member. If a member 
reports information that appears to be a complaint, the information is recorded 


in the health plan’s system, and is referred to the Grnevance and Appeal unit. 


Case Managers work directly with members through the assessment process and 
directly refer them to appropnate providers so they obtain the health care 
services they require. They work directly with the memberto develop a “care” 
(treatment) plan. They include providers in this process to enhance the plan and 
to ensure that all available servicesare part of the plan. The Case Managers 
work with other health plan staff, such as Concurrent Review Nurses, to ensure 


that they are aware of all members needing case management, and to expand 
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their knowledge of the services needed by health plan members. The Case 
Managersco-case manage with the Behavioral Health unit. These units disc uss 
cases, referto one another, and work collaboratively in providing servicesto 
members. One unit becomesthe primary source of contact with members to 


avoid confusion. 


Case Managersand Member Services staff expressed a commitment to ensuring 
that members have the health care servicesthey need. They contact providers, 
include them in treatment planning, and advocate for member when necessary. 
The member centered atmosphere was evident in the responses received to 


questions. 


The rating for Access Standards (100%) indicates the health plan’s commitment 
to maintaining full compliance with all MO HealthNet Managed Care 
requirements and federal regulations. All practice in thisarea observed atthe 
time of the on-site review indicated that Missoun Care worked toward ensuring 


that members have accessto all the healthcare services that they may require. 
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Table 83 - Subpart D: Quality Assessment and Performance Improvement Access Standards Yearly 
Comparison (MOCare) 





: Missouri Care 
Federal Regulation 


2005 2006 

438.206(b)(1)(i-v) Availability of Services: Provider Network 2 2 2 
438.206 (b) (2) Access to Well Woman Care: Direct Access 2 Z 2 
438.206(b)(3) Second Opinions 2 2 2 
438.206(b)(4) Out of Network Services: Adequate and Timely 2 2 2 
Coverage 

438.206(b)(5) Out of Network Services: Cost Sharing 2 2 2 
438.206(c)(1)(i-vi) Timely Access 2 2 2 
438.206(c)(2) Provider Services: Cultural Competency 2 2 2 
438.208(b) Care Coordination: Primary Care 2 2 2 
438.208(c)(1) Care Coordination: Identification 2 2 2 
438.208(c)(2) Care Coordination: Assessment 2 2 2 
438.208(c)(3) Care Coordination: Treatment Plans 2 2 2 
438.208(c)(4) Care Coordination: Direct Access to Specialists 2 2 2 
438.210(b) Authorization of Services 2 2 2 
438.210(c) Notice of Adverse Action 2 2D 2 
438.210(d) Timeframes for Decisions, Expedited Authorizations 1 2 2 
438.210(e) Compensation of Utilization Management Activities 2 2 2 
438.114 Emergency and Post-Stabilization Services 1 2 2 
Number Met 15 17 17 
Number Partially Met 2 0 0 
Number Not Met 0 0 0 
Rate Met 88.2% 100.0% 100.0% 


Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Structures and Operation Standards 

Credentialing policiesand practices were reviewed on-site. All credentialing 
performed by Missour Care meetsNCQA standard and complies with federal 
and state regulations, and the SMA contract requirements. Re-credentialing is 
completed at three-year intervals, and delegated entities are monitored 
annually. State and federal sanctions are monitored monthly using the HHS 
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OIG/OPM (Office of Inspector General/Office of Personnel Management) web 
site. Intemal information regarding grievancesand quality issues are also 
monitored. Compliance with policies related to advance directivesis monitored 
in records of primary care providers pnor to re-credentialing (for PCP, hospital, 
home health agency, personal care provideror hospice). Confidentiality, 


nondiscrimination and rights to review files and to appeal are allincluded. 


Delegation agreements are developed in accordance with Missoun Care policy. 
The delegation of responsibility must include all delegated activities and the 
organization’s accountability for those activities. Five entities were audited in 
2006. Fourpassed. One, Crown Optical, was re-audited on three subsequent 
occasions, with an emphasson policiesand procedures. Full compliance was 


achieved in J anuary 2007. 


Member Services staff was questioned about their resoonse to members who 
requested disenrollment. They explore the request with the member to ensure 
that it isnota resolvable issue. If the problem is related to a provider, suchas 
wishing to accessa PCP outside of the network, Provider Relations is involved to 
attempt to recruit the provider into the Missouri Care network. If the problem 
can not be solved, the Member Services staff member refers the member to the 
Enrollment Department so the processcan be completed. If the problem isthe 
result of an issue that should be a grievance orappeal, this type of referral is 
made and sent to that unit. Member Services staff relates that they have 
experienced an issue that appeared to be a fraud and abuse situation, this 


information was referred to Provider Relations for further action. 


The rating for Structure and Operations (100%) reflects full compliance with the 
MO HealthNet Managed Care contract requirements and federal regulations for 
the third consecutive year. The health plan submitted all required policy for 


approval, and all practice observed at the time of the on-site review indicated 
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compliance in thisarea. All credentialing policy and practice wasin place. All 


disenrollment policy wascomplete and all subcontractual requirements were 


met. 
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Table 84 - Subpart D: Quality Assessment and Performance Improvement Stucture and Operation 
Standards Yearly Comparison (MOCare) 








Missouri Care 
Federal Regulation 






438.214(a,b) Provider Selection: 



















Credentialing/Recredentialing 2 
438.214(c) and 438.12 Provider Selection: 2 2 2 
Nondiscrimination 
438.214(d) Provider Selection: Excluded 2 2 2 
Providers 
438.214(e) Provider Selection: State 2 2 > 
Requirements 
438.226 and 438.56(b)(1-3) Disenrollment: 2 

; eaneee 2 2 
Requirements and limitations 
438.56(c) Disenrollment Requested by the 2 > 3 
Enrollee 
438.56(d) Disenrollment: Procedures 2 2 2 
438.56(e) Disenrollment: Timeframes 2 2 2 
438.228 Grievance System 2 2 2 
438.230(a,b) Subcontractual Relationships and 2 > 2 
Delegation 
Number Met 10 10 10 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 


Rate Met 100.0% 100.0% 100.0% 














Note: 0 =Not Met; 1= Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Measurement and Improvement 

Missouri Care operated a Quality Management Oversight Committee made up 
of the Chief Executive Officer, Plan Administrator, Chief Medical Officer, and 
department managers. The goal of thisgroup wasto provide oversight of all 
operations and health plan initiatives. The health plan adopted and 
disseminated practice guidelinesin the areasof diabetes, asthma, chronic 
obstructive pulmonary disease (COPD), ADHD, and congestive heart failure. 
This information was available to all providers on the health plan’s website. 
Missoun Care indicated that they were in the process of developing practice 
guidelines for depression management. Disease management is directed from 
the health plan Corporate Office and covers asthma treatment, COPD, diabetes 
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and CHF. Co-case Management can occur when it isin the members best 


interest. 
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Sentinel events and quality of care issuesare tracked to identify pattems that 
may evolve. Any suspected issue istaken to committee for discussion. Ifa 
problem is identified or suspected, follow-up occursimmediately. Outside review 
isthen requested. Potential issues with providers in a facility have been 


addressed by facility sta ff. 


The health plan submitted two Performance Improvement Projects (PIPs), which 
included enough information to complete validation. All Performance 
Measurement data and medical records requested were submitted for 
validation within requested timeframes. Missouri Care did have a health 
information system (HIS) capable of meeting the MO HealthNet Managed Care 
program requirements. The health plan also submitted all required encounter 
data in the format requested. The specific details can be found in the 


appropnate sections of this report. 


Member Services hashad no requests for practice guidelines, or other issues 
related to Measurement and Improvement. Case Managers report that they are 
aware of practice guidelines. They have nothad members call and specifically 
ask forthese. Membersdo calland ask about medication management and 
other issues that are pertinent to existing practice guidelines. They may aska 
member if they want a copy to take with them to an appointment to ensure that 


all medical care is received. 


The rating forthe Measurement and Improvement section (100%) reflects that all 
required policy and procedure had been submitted to the SMA for their 
approval forthe third consecutive year. Itappeared that all practice observed 
at the time of the on-site review met the requirements of the MO HealthNet 


Managed Care contract and the federal regulations. 
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Table 85 - Subpart D: Quality Assessment and Performance Improvement Measurement and 
Improvement Yearly Comparison (MOCare) 












Missouri Care 


2005 2006 













Federal Regulation 


438.236(b)(1-4) Practice Guidelines: Adoption 2 2 2 
438.236(c) Practice Guidelines: Dissemination 2 2 2 
438.236(d) Practice Guidelines: Application 2 2 2 
438.240(a)(1) QAPI: General Rules 2 2 2 
438.240(b)(1) and 438.240(d) QAPI: Basic Elements of MCO 2 2 2 
Quality Improvement and PIPs 

438.240(b)(2)(c) and 438.204(c) QAPI: Performance 2 2 2 
Measurement 

438.240(b)(3) QAPI: Basic Elements/Over and Under 2 2 2 
Utilization 

438.240(b)(4) QAPI: Basic Elements regarding Special 2 > > 
Healthcare Needs 

438.240(e) QAPI: Program Review by State NA NA NA 
438.242(a) Health Information Systems 2 2 2 
438.242(b)(1,2) Health Information Systems: Basic Elements 2 2 2 
438.242(b)(3) Health Information Systems: Basic Elements 2 2 2 
Number Met 11 11 11 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: Regulation 438.240(e) refers to program review by the state. The regulation requires the state 
to review, at least annually, the impact and effectiveness of each MCHP's quality assessment and 
performance improvement program. The regulation refers to the state QA & | program review 
process and isnot applicable to Extemal Quality Review of the MC+Managed Care Program. This 
percent is calculated forthe regulations that are applicable tot the MC+Managed Care Program. 
0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol fordetermining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols. 


Grievance Systems 

The gnevance system operates efficiently in this office. The health plan sta ff 
explained that when they receive providercomplaints, these are reviewed by 
the provider representatives in the provider offices. They find that most of these 
complaints are the result of claims issues, such astimely filing. Many of these 
resulted from behavioral health providers who do not submit invoices within 


prescribed timeframes. The health plan believes this issue will be resolved with 
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training and continued support from the provider representatives. The Medical 
Director is maintaining regular communications with the providers, resulting in 


fewer calls or formal complaints being filed. 
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Member Services staff reports that when a callisreceived froma member who 
wished to file a grievance, information regarding who wasinvolved and what 
happened isentered into the call tracking system and sent to the Member 
Services Manager for referral to the Grievance Unit. If the information involvesa 
provider, Provider Relations isinvolved. The staff indicatesan awareness of the 
gnevance resolution processand the need forexpedited resolution. Member 
Services staff indicated that they assist membersin writing a grnevance if 
necessary. It was reported that grievancesand appealsare trended and sent to 
the Quality Management Committee for review and action. Trendsare 
observed and follow-up with the appropriate providers, or health plan unit, 


occurs to resolve issues that may be leading to the grievances orappeals. 


Case Managers reported that they are aware of the process for assisting 
membersin filing a grievance. They stated that ifa member contacts them with 
a complaint, they inform the member of their right to file a gnevance and 
encourage them to follow through with this process. If the member wishes to file 
the grievance, the case manager assists them through the process. The actual 
filing ishandled by the Member Services Department. If the memberis 
dissatisfied with the outcome they are informed of their right to file a State Fair 
Hearing. Case Managersare also contacted when members receive a 
negative authorization decision. The Case Managerassists the member in 
following up with the PCP or physician to ensure that adequate information was 


provided, orin filing the appeal. 


The rating forGrevance Systems (100%) reflects that all policy and practice met 
the requirements of the MO HealthNet Managed Care contract and federal 
requirements for the third consecutive year. It was evident, both in reviewing 
policy, gievance documentation, and in discussing this process with health plan 
staff that the grievance and appeal process was taken seriously. Staff expressed 


the opinion that this wasan essential protection formembers. 
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Table 86 - Subpart F: Grievance Systems Yearly Comparison (MOCare) 
Missouri Care 


2005 2006 


Federal Regulation 


438.402(a) Grievance and Appeals: General Requirements 2 2 2 
438.402(b)(1) Grievance System: Filing Requirements - 2 2 > 
Authority 

438.402(b)(2) Grievance System: Filing Requirements - 2 

Timing 2 2 
438.402(b)(3) Grievance System: Filing Requirements - 2 2 > 
Procedures 

438.404(a) Grievance System: Notice of Action - Language 2 2 2 
and Format 

438.404(b) Notice of Action: Content 2 2 2 
438.404(c) Notice of Action: Timing 2 2 2 
438.406(a) Handling of Grievances and Appeals: General 2 2 2 
Requirements 

438.406(b) Handling of Grievance and Appeals: Special 2 

Requirements for Appeals 

438.408(a) Resolution and Notification: Basic Rule 2 

438.408(b,c) Resolution and Notification: Grievances and 2 ) 
Appeals - Timeframes and Extensions 

438.408(d)(e) Resolution and Notification: Grievance and 2 2 2 
Appeals - Format and Content of Notice 

438.408(f) Resolution and Notification: Grievances and 2 2 2 
Appeals - Requirements for State Fair Hearings 

438.410 Expedited Resolution of Appeals 2 2 
438.414 Information about the Grievance System to 2 ) 2 
Providers and Subcontractors 

438.416 Recordkeeping and Reporting Requirements 2 2 2 
438.420 Continuation of Benefits while Appeal/Fair Hearing 2 > > 
Pends 

438.424 Effectuation of Reversed Appeal Resolutions 2 2 2 
Number Met 18 18 18 
Number Partially Met 0 0 0 
Number Not Met 0 0 0 
Rate Met 100.0% 100.0% 100.0% 





Note: 0 =Not Met; 1=Partially Met; 2 =Met 

Sources: Department of Health and Human Services Centers for Medicare & Medicaid Services 
(2003). Monitoring Medicaid Managed Care Organizations (MCOs) and Prepaid Inpatient Health 
Plans (PIHPs): A protocol for determining compliance with Medicaid Managed Care Proposed 
Regulations at 42 CFR Parts 400, 430, et al. Final Protocol Version 1.0.; BHC, Inc., 2004 Extemal 
Quality Review Monitoring MCOs Protocols 
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CONCLUSIONS 

Missour Care continues with their commitment to meeting all policy, procedure, 
and practice requirements to be in compliance with the MO HealthNet 
Managed Care contract and the federal regulations. The health plan utilized 
the tools produced by the 2005 and 2006 Extemal Quality Review as guidelines in 
ensuring that required written materials were submitted to the SMA in a timely 
and efficient manner. The staff within Missour' Care exhibited a commitment to 
quality and integrity in the work with their members. The health plan utilized 
unique processes, such asbringing the provision of behavioral health services 
into the organization, asa method for improving the access, quality and 
timeliness of member services. Missoun Care created toolsto educate and 
inform the community and providers, evidenced by the efforts made to improve 
EPSDT examination numbers. The health plan demonstrates an attitude of 
respect toward their members in a number of outreach initiatives, as wellas 
efforts to utilize software tools to better identify special healthcare needs. 
Missoun Care attempted to create a healthcare service system that was 
responsive and assists members in overcoming the bamiers they encounterina 


largely rural area. 


Staff reflected a new sense of energy and animation in the response to questions 
that appeared to be a reflection of health plan leadership. They disc ussed 


improved communication and collaboration within their organization. 


QUALITY OF CARE 

Quality of care isa priority for Missour Care. Theirattention to intemal and 
extemal problem solving, supporting and monitoring providers, and participation 
in community initiatives are evidence of a commitment to quality healthcare. 
Missouri Care completed all policy requirements and has put processes in place 


to ensure that proceduresand practicesfollow approved policy requirements. 
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A commitment to obtaining quality service for membersis evident in interviews 
with health plan staff, who express enthusiasm for their roles in producing sound 


healthcare for their members. 
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ACCESS TO CARE 

Missoun Care hasmade concerted efforts to ensure that members throughout 
the Central Region have adequate accessto care. They have recruited 
additional hospitals and individual providers into their network. The health plan 
has participated in community events to promote preventive care and to ensure 
that members are aware of available services. ThisRegion coversa diverse 
geographic area and the health plan exhibits an awareness of and commitment 
to resolving issuesthat are bamiersto memberservices. The staff report that their 
ability to access behavioral health services for members, including their 
coordinated case management process, has ensured that members have 
greatly improved accessto care. 


TIMELINESS OF C ARE 

Missour Care hasdeveloped proceduresto ensure that policy is submitted ina 
timely manner and that all tracking tools are up-to-date. They are utilizing new 
case management software and systems toolsto have the most accurate and 
up-to-date information available to support membersin obtaining appropriate 
healthcare servicesin a timely manner. The health plan hasengaged ina 
number of activities to ensure that organizational processes support the delivery 
of timely and quality healthcare. 


RECOMMENDATIONS 
1. Continue health plan development in the area of utilization of available 
data and memberinformation. This will drive change and create 
opportunities for further service development. 
2. Continue working with school districts and other community-based entities 
throughout the Central Region to contact members for educational 
opportunities. 
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3. Continue monitoring accessto dental care and assist in recruitment of 


providers throughout the Central Missouri Region. 


Performance Management Solutions Group 654 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Appendices 
Report of Findings - 2007 


Appendices 





Performance Management Solutions Group 655 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Appendices 
Report of Findings - 2007 


(this page intentionally left blank) 


Performance Management Solutions Group 656 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Appendix 1 
Report of Findings - 2007 MCHP Onentation PowerPoint Slides 





Appendix 1 - MCHP Onentation PowerPoint Slides 


| (ae 
i Solutions Group 
ON aOhsin of Gahnkral Hath Coens, ie: AE, 


Introductions 
Orientation to Technical Methods and 
Objectives of Protocols 
Review of Information, Data Requests, and 
Timeframes 
Performance Measures 
Performance Improvement Projects 
Encounter Data Validation 
Compliance and Site Visits 
Closing Comments, Questions 


Orientation Agenda 
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Materials Provided 






Objectives and Technical Methods 
Validation of Performance Measures 
Validation of Encounter Data 
Validation of Performance Improvement Projects 
MCO Compliance 

Requests for information and data 

List of BHC contacts for each protocol 


Presentation 
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Overview 






Protocol Activities 
Information and Data Requests 


Contact Persons 
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Validation of 
Performanee Measures 


HEDIS 2007 Measure Validation for MC+ 
Adolescent Well-Care Visits 
Annual Dental Visit 
Follow-up after Hospitalization for Mental 
Health Disorders 

Administrative 

Hybrid method 


Review up to 30 medical records per measure 
sampled randomly 
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Submission Requirements 
for PM Validation 
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For each of the three measures: 
2007 HEDIS Audit Report 
Baseline Assessment Tool for HEDIS 2007 
BHC EQRO Performance Measure Checklist (Method for Calculating HEDIS Measures; Table 1.xIs) 
List of cases for denominator with all HEDIS 2007 data elements specified in the measures 
Use an appropriate delimiter (e.g., @ for data that may contain commas or quotation marks). 
Data layout for the files will be provided in the data request, this data layout must be used to ensure validity 
Listing of fields names and descriptions of fields (i.e., data dictionary) 
List of cases for numerators with all HEDIS 2007 data elements specified in the measures 
Use an appropriate delimiter (e.g., @ for data that may contain commas or quotation marks). 
Data layout for the files will be provided in the data request, this data layout must be used to ensure validity 
Listing of fields names and descriptions of fields (i.e., data dictionary) 
List of cases for which medical records were reviewed, with all HEDIS 2007 data elements specified in 
the measures 


BHC will request MCOs to gather up to 30 records per measure, based on a random sample, and MCO 
will send copies 


Sample medical record tools used for hybrid methods for HEDIS 2007 measures and instructions. 


All worksheets, memos, minutes, documentation, policies and communications within the MCO and with 
HEDIS auditors regarding the calculation of the selected measures 


Policies, procedures, data and information used to produce numerators and denominators 
Policies, procedures, data used to implement sampling 

Policies and procedures for mapping non-standard codes 

Others as needed 
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Randomly selected encounters from medical 
claims, with service dates July 1, 2007 — 
September 30, 2007 

Review MCO supplied medical records for 
matching claims 


Match state and MCO claims databases for 
all encounters 
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(Sazes~,. ) Sampling 


1. All State Encounter 
Claims, 
July 1, 2007 — September 30, 
2007 


2. State Medical 
Encounter 
Claims 
(N = 100 per 
MCO) 
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3. All MCO encounter 
claims, 
July 1, 2007 — September 
30, 2007 
(N = 100 cases per MCO) 
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Critical fields will be examined for 
completeness (data in field), accuracy 
(correct type and length of data), and 
reasonableness (valid data for field) for each 
MCO. This will be conducted for all 
encounters in the specified time frame. 





Analyses: 1 
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Analyses: 2 





BHC will abstract the medical records and claims history/forms for 
each patient for the medical service provided during the entire time 
frame, enter into a database, and determine the rate(s) of matches, 
omissions and commissions between the medical record and the 
State encounter claims for each MCO. Matches will be cases that 
are consistent on patient ICN, date of service, and diagnosis or 
procedure code. 












State Medical 
Encounter Claims, 
July 1, 2007 — 
September 30, 2007 
(N = 100 per MCO) 













Medical Records 
(N = 100 per MCO) 






ICN-DOS-Code 
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Analyses: 3 






BHC will determine the rate(s) of matches, omissions 
and errors between the State encounter claims and 
MCO encounter claims for each MCO for the sample of 
selected cases. 

















MCO Encounter 


All State Encounter Claims (paid and 
Claims, July 1, 2007 unpaid) 
— September 30, ICN-DOS-Code July 1, 2007 — 
2007 September 30, 2007 
(N = 100 per MCO) (N = 100 per MCO) 
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Encounter Data 


¢ i, Performance Management 





_tntietaecomsts / Validation Submission 


File 1: Provider mailing address and contact information for sampled 
claims (Service dates July 1, 2007 to September 30, 2007). This will be 
used for validation of the State medical encounter claims database 
against the medical record. 


File 2: All inpatient encounters from July 1, 2007 to September 30, 
2007 for selected MC+ members, with detailed provider information. 
This should be in the layout specified by BHC in the Encounter Data 
Submission Instructions. 


File 3: All outpatient encounters (Outpatient, Medical, Dental, and 
Home Health) from July 1, 2007 to September 30, 2007 for selected 
MC+ members, with detailed provider information. This should be in the 
layout specified by BHC in the Encounter Data Submission Instructions. 


File 4: All pharmacy encounters from July 1,2007 to September 30, 
2007 for selected MC+ members, with detailed provider information. 
This should be in the layout specified by BHC in the Encounter Data 
Submission Instructions. 


NOTE: “unpaid claims” are those claims that the MCO denied for payment, unpaid claims do 
not include claims paid via a capitation plan. 
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Medical Record 
Reviews 
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Encounter 
Encounter sample provided to MCO 
MCO to develop Files 1 (2 weeks from receipt of sample) 
MCO to develop Files 2, 3, 4 (6 weeks from receipt of 
sample) 
MCO to submit medical record request to providers (1 week 
from development of File 1) 
MCOs to ensure providers supply medical records to BHC (4 
weeks from submission of request to providers) 

HEDIS 
Medical record samples requested from MCOs 
for 1 possible hybrid measure (N < 30 per 


measure; 4 weeks) 
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Medical Record 
Reviews (Cont’d 


MCO will request and obtain Medical Records 
from providers 
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Letter from Sandra Levels 

Instructions for submitting records 

Encounter claim supporting information, dates, 
notes, claims information 

Explanation of Confidentiality, storage of files 


Explanation of HIPAA, Business Associate 
Agreement, Health Oversight Authority 
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P _ Medical Record 
<< Reviews (Cont’d 


a Dhsion  erreet Concepts, inc. BHC 
Reviewed and abstracted by experienced and 
certified medical coders 










Standard abstraction tools 


Matching ICN, Date of Service, Diagnosis 
Code, Procedure Code 
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Validation of Performance 
lnmprovement Projects 






Two Performance Improvement 
Projects underway in 2007 


One clinical 


One non-clinical 
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PIP Checklist Elements 


Project narratives, baseline measures, methods, interventions, and planned analyses. 
Examples of information are contained in the CMS protocol, Validation of Performance 
Measures] 1] 

Phase-in/timeframe for each phase of each PIP[1] 

Problem identification 

Hypotheses 

Evaluation Questions 

Description of intervention(s) 

Methods of sampling, measurement 

Planned analyses 

Sample tools, measures, surveys, etc. 

Baseline data source and data 

Cover letter with clarifying information 

Raw data files (if applicable, on-site) 

Medical records or other original data sources (if applicable, on-site) 

Additional data as needed 


[1] U.S. Department of Health and Human Services, Centers for Medicare & Medicaid 
Services (2002) VALIDATING PERFORMANCE IMPROVEMENT PROJECTS A protocol 
for use in Conducting Medicaid External Quality Review Activities: Final Protocol Version 
1.0 May 1, 2002 
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MCO Compliance 





Enrollee Rights 





Grievances and Appeals 
Quality Improvement 
Submission Requirements TBD 


Mental Health Case Management 
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Site Visits 


Target for July 2008 


One to two weeks earlier than last year. 






MCO Compliance Reviews 

On-site activities 
Performance Measure Validation 
Performance Improvement Project Validation 


jelutions Group 
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Final Report 









MCO to MCO Comparisons: 
Encounter data match/fault rates for 
diagnoses and procedures 
Performance Measure audit findings 
and rates 
Performance Improvement Project 
element compliance 


MCO Compliance follow-up 
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* , So BHIC Team and Coordination 


a Dhision of Behavioral Health Concepts, Inc. AE» 


BHC Contact 
Behavioral Health Concepts, Inc. 
2716 Forum Blvd., Suite 4a 
a Columbia, MO 65203 
Protocoll Activity Tel. 573-446-0405 Fax 573-446-1816 
Amy McCurry Schwartz 


amccurry@pmsginfo.com 
Performance Measures 


(HEDIS 2007) 


Amy McCurry Schwartz 
amccurry@pmsginfo.com 


Mona Prater 
Performance Assistant, Project Director 


Improvement Projects mprater@pmsginfo.com 


Amy McCurry Schwartz 
Encounter Data amccurry@pmsginfo.com 
. Mona Prater 
MCO Compliance mprater@pmsginfo.com 


Amy McCurry Schwartz 
amccurry@pmsginfo.com 


. -_ Mona Prater 
Site Visits mprater@pmsginfo.com 


; Amy McCurry Schwartz 
Medical Records amccurry@pmsginfo.com 
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Performance Improvement Project Validation Worksheet 


Use this or similar works heet as a guide when validating MCO/PIHP 
Performance Improvement Projects. Answer all questions for each 
activity. Refer to protocol for detailed mformation on each area. 





ID ofe valuator Date ofevaluation 
Demographic Information 
McCO/PIHP Name or ID Project Leader Name Telephone Number 





Name of the Perform ance Improvement Project 





Dates of Study Date Study Initiated 


Type of Delivery System (check all that apply) 


H StaffModel GB Network GB Director IPA 

HIP aA Organization Gnmco G PIHP 
Number of Medicaid Enro llees Number Medicare Enro llees in 
inMCO orPIHP* MCO or PIHP 
Number ofMedicaid Enzo llees Total NumberofMCO or PIHP 
in the Study Enzo llees in Study 
NumberofMembersinStudy _ Population of Members in 


Sample Frame 


Number of MCO/PIHP Number of MCO/PIHP 
primary care physicians specialty physicians 
Population ofphysicians in Number of physicians in study 


sample frame 


Note: DK = Don'tKnow; NA= Not Applicabk 


* Source: Missouri Medicakl Management Information System COLD Reparts, State Session MPRI Screen, Revised June 25, 
2c. Enrollment total include enralkes with a future start date; 125, 1925b, and Title XX1 enrolkees as af June 25, 2c«04-. 
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Activity 1: ASSESS THE STUDY METHODOLOGY 





Step 1. Review the selected study topics(s) 


ii The wpic was selected through datacollection [Ey Met Partially met [Ey Not met 
ao, saperts f enrelien [Dy Not applicahie By Unb to determine 


Topic or problem 
statement 
Chnical 
(J Prevention of an acute or chronic condition (J High vohime services 
(CJ cae foranacute or chionic condition ( High risk conditions 
Nonchnical 
[([) Proosss of aonessingor delivering care 
comments 








uz MC O's /PIHP s PIPs, over time, addressed a broad By Met Gi Partially met fy Net met 


spectrum of key aspects of enrollee cave and services. [iy Net applicable [i] Unable to determine 


Project must be clearly focused an identifying and correctingdeficiencesin care ar 
servicesr ather than on utilization or cost alone. 


Comments 
1.3 MCO's/PIHP s PIPs over time, nduded all [Met [i] Partially met [ey Not met 
enrolled populations: Le., didnot exclude certain 
enrollees such as those with special health care iy Not applicatie By Unable to determine 
needs. 
Pp. 
Demographic description Age ia 
of MC+ population acer Race MC+ 
Comments —_ 
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Step 2: Review the study question(s) 


2.1 Study question(s) stated clearly in writing, [my Met [i Partially met [Hy Not met 
Oo Not applicable BH Unable to determine 

Stady question(s) as 

stated in narrative: 

Comments 


Step 3. Review selected study indicators(s) 














3-4 The study used objective, clearly defmed, Met [i Partially met [Ey Not met 
monmar able maicaters. Not applicable Ey Unable to determine 
Indicators (lst 
Comments 
3-2 Theindicators measured ch mgps mm health status, fy Met = Partially met [Hy Not met - 
function al status or enrollee satisfaction; or process of ; ; . 
care with strong association with improved outcomes. —_ [J] *" 2p plicatle [i] Unatde ta determine 
Long term outoom es im plied or stated: Bi ves No 
Healkhstats: Satffaction (members): 
Furctional status: Satsfaction (providers): 
Comments 
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Step 4: Review the identified study population 





4.1 MCO/PINP clearly defined al medicaid enrollees Met [i] Partially met [i Not met 
— stay questions and n@icaters are oO Not applicable a] Unable to determine 
Demographic description of Age —— _ MC+ 
mc+ population sam pled Gender Commercial 
Didit meclude: 
1115 Ye [Ne [Ey] Lnable to determine ENA 
19158 Ye [Na [ Unabee w determine Na 
Chikikan in state custocly five HN habe: to determine na 
Consent Decmee (Wester) Ye [Na [Hl nab to determine Na 
Comments 
4.2 If the NCO /'PIH P studied the entire population, did fay Met [Hy Partially met [Hy Not met 
its data collection approach capture all enrollees tw 
whom the study question apphed? [i] Not applicahle [a] Unable to determine 
Methods of dentifying = 7 utilization data CD weferral 
patticipants fy. ate ad 
UO self-identific ation Dotter 
Comments 


Step 5: Review sampling methods 


5-1 Sampling techniqueconsidered and specifiedthe [] Met (Partially met (not me 
true (or estimated) frequency of occurrence of the : 
event, the confidence interval to beused, andthe © Not applicable © unable to determine 
margm of the error that willbe acceptable. 


Previow findings from: 
OO literature review Ci bxseline assessm ent ofindics OJ otter 


Comments 
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5-= The MCO/PIHP employed valid sampling pie [Ey Writely re fy] hat met 
peter inet: py Caer agen ae ae | Fon | eqn yterecatile Bi! wel te determine 
The type ofsam pling used: 
DProbability (CD Nonprobability CO Random Osimple C1 stratified 
Oconvenience KD suigment Oowta Ochustar 

Comonents 
5.3 Sample contamed sufficientnumber of enrollees. fe Ey terrier [Ey Pet re 

a [Ey eetien teobeneereinne 
Nof enrolkes in sam plirg frame N ofsample 
N of participants (ie, return rate) 
Comunents 


Sten & Revievedata collection pracediites 


6.1 Study design clearly sp ecified the datato be Eee BE Ptied ene EE] Nerd nies 
collected. 
fl PT ee mu oe ae 


C onuments 
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6.2 The study design clearly specified the sources a Stir ine A 
of data. 
fo hetonniestie fl! tate io detenn aie 
Source of data 
Cimember ([]Chims Dlmoviies [otter 
Toman ets 


@ (Pe - fa fies yee 


6.3 The study design specified a systematicmethod = \\- 
Bo De a 


of collecting vahd and rehable data thatrepresents 
the entre population to which the study's Ey How oqntionaie 


indicators apply. 


Dinrarents 


6.4 The instruments for data collection pro vided for ihe Le] ery ares Ey err a 
consistent, accur ate data collection over the time 
perio ds studied. [i] Menai LE! ital bu pleeerrtete 
Inst ent(s) wed 

(C1 survey (I) Medical Record Abstraction Tool (other 
5 were) beets 


Rage Gor | 
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6.5 the study design prosp ectively specified a data Mei [Ey er temnsy ve By ho oes 
analysis plan. | {ert cyte) hancad rie fl! ah to eermine 
Comments 
6.6 Qualified staff and personnel were used to collect Ne [Sr ty et [Ey Wot se 
thedata. 
Gl Mets (E] bustle ta detenn air 

Name —_ Tk _ 
Role(s) of Project Leader 

Comments 


) Step 7: Assess linpeavement stratepsies 


7.4 Reason ableinteryentions were undertaken w Gi Ne EE) ertaliv mes Ey Wet mes 

address causes barriers identified through data 

malysis and QIprocesses undertaken. Bey Wet conic We DP Vaalic iodeesmine 
Describe Intervention: 

Comanents 
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Step 8: Review data analysis and interpretation of study results 


NAif study is not yet complete 


S.1Aan analysis of thefindings was performed GB Met [Ey Partially met Ey Not met 
according to data analysis plan. Oo Nat applicable Oo Unabk to determine 


Not metifstudyis complete and no indication ofa data analysis plan (see step 65) 


Comments 

$.z The MCO /PIH P presented numerical PIP results fy Met [iy Partially met [Ey Not met 

and findings scones ane ay. By Not appliatle By Unabk to determine 
CO Are tables ard figures labeled? (Co Latekd clearly, accurately? 


Comments 


8.3 The analysis identifiedinitial mdrepeat 
measurements, statistical significance, factor's that 
influence compar ability of initial and rep eat 
measurement, and factors that threaten ternal and 
extern al validity. 


G Met Oo Partially met B Not met 


[i Not applicabke [i Unable to determine 


Indicate time periods af 
measurements: 


Indicate statistical analyses 
used: 


Indicate statistical significance kvel ar 
confidence level used: 3% fj 95% [i] Unatie to deternine 


Comments 





BHC ©2005 Behaworal Health Concepts, Inc. Page Sor 11 











ee Performance Management Solutions Group 686 
: A division of Behavioral Health Concepts, Inc. 


none «hema vemee Conn we BWC 


MO HealthNet Managed Care Extemal Quality Review Appendix 2 
Report of Findings - 2007 Performance Improvement Project (PIP) Worksheets 











8.4 analysis of study datainchuded an mterpretation =) pret [Dy Partially met [not me 
of the extent to which its PIP was successful and 
follow-up activities. [Not applicable ff unable to determine 
Limitations described: 
Corelusions regarding the suocess 
of the interpretation 


Recommendations for follow-up 
Comments 





Step 9: Assess whether improvement is “real” improvement 


Note: NA only ifstudy period is not yet complete: otherwise “ Unable to Determine™ or “No” 


9.1 The same methodology as the baselme fy Met By Partially met [By Not met 
measurement was used when measurement was : . 
repeated. I] Not applica hie & Unabke to determine 
Same souwre ofdata Ore Ne By Not applicatle By Unable to determine 
Same method ofdatacollecton [] re Ne fy Not applicable By Unable to determine 
Same participants examined Ove i No By Not applicatle By Unable to determine 
Same took wed Gre J Ne [y Not applicable By Unable to determine 
Comments 
9.2 Therew as adocumented, quantitative Hy Met [i Partially met [Not met 
Improvementm proces or outcomes of care. . . : 
& Notapplikabk a} Unahle to determine 
(increased [E] decrease 
Statistical significanne Clinical significance 
Comments 
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9.3 The reported improvement in peformancehave [Met (] Partially met [] Not me 
"face" validity:i.e., the Improvement performace 
app ears to be the result of the planned quality (4) Not applicable (] unable to determire 
improvement intervention. 
Degree to which the intervention was p ; 
tha necaweiee OO No rekvance small 0 Far O High 
comments 
9.4 Thereis statistical evidence that any observed Met [EPanially met = Not met 
p formance improvementis true improvement [i] Not applicable [i] Unatle ta determine 
J Weak [ Moderate Gi sting 
Comments 


Step 10: Assess sustained improvement 


10.1 Sustainedimprovementwas demonstrated DO Met CD Partially met = [[] Not met 
through rep eated measurements ove: comparable oO Nat applicable oO Unahbk to determine 
time periods. 

comments 
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ACTIVITY 3: EVALUATE OVERALL VALIDITY AND RELIABILITY OF STUDY 
RESULTS: SUMMARY OF AGGREGATE VALIDATION FINDINGS AND 
RECOMMENDATIONS 


Conclusions 


Recommendations 


Check one: 


[High confidence is reported [E] Low confidence level is reported in MCO/PIHP PIP results 
[9] Moderate confidence is reported MCO/PIHP PIP results [) Reported MCO/PIHP PIP results not credible 


[Not Applicable, study rot com plete 
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Appendix 3 - Performance Measures Request Doc uments 
Performance Measure Validation 


General Instructions 


Mail Binder To: 

Atin: Extemal Quality Review Submission 
Behavioral Health Concepts, Inc. 

2716 Forum Bivd., Suite 4 

Columbia, MO 65203 


Due Date: J anuary 28, 2008 


When applicable, submit one foreach of the three measures: 
e Follow-Up After Hospitalization for Mental Illness (FUH) 
e Annual Dental Visit (ADV) 
e Adolescent Well-Care Visits (AWC) 


Unless otherwise indicated, please send all documents in hard copy, 
using the enclosed binderand tabs. If an item isnot applicable ornot 
available, please indicate this in the tab. 


Electronic Data Submission Instructions: 

e Data file formats all need to be ASCII, and readable in a Microsoft 
Windows environment. Please be sure to name data columns with 
the same vanable names that appearin the following data layout 
descriptions. 

e Make all submissions using compact disk (CD) formats. Data files 
submitted via e-mail will not be reviewed. Insure that fileson the 
CD are accessible on a Microsoft Windows workstation prior to 
submitting. 

e AllfilesorCDs must be password protected. Do not write the 
password on the CD. Please email the password separately to 
amccuny@pmsginfo.com. Do not include the password 
anywhere on the CD, orin any corespondence sent with the CD. 

e Use anappropnate delimiter (e.g., @, tab) fordata that may 
contain commasor quotation marks, and please specify ina 
readme file or write on the CD what that delimiter is. 

e Please ensure that date fields either contain a null value ora valid 
date. 

e Files willbe accepted only in the specified layout. Please avoid 
adding extra columns orrenaming the columns we have 
requested. 
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There should be 3 separate files submitted foreach measure: 
File 1. Enrollment Data 


File 2. Denominator and numerator file 

File 3. Sample selection (cases that were selected for medical 
record review); this file is submitted for Hybond measures 
only 


The file layouts to be used foreach measure are detailed on pages 
2-7 of this doc ument. 


Please contact BHC priorto the submission deadline if you have any 
questions regarding these layouts or the data submission 
requirements, and we will be happy to assist you. 
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Performance Measures (PM) Request Documents 


Follow-Up After Hospitalization for Mental Iliness (FUH) 
(Ad ministrative Only) 


File 1. Enrollment Data 
Please provide all enrollment periods for each eligible Memberto 
verify continuous enrollment and enrollment gaps. 


Field Name 
MCHP 
MEASURE 


DCN 
MEMBR_FIRST 
MEMBR_LAST 


DOB 
ENROLL_FIRST 


ENROLL_LAST 


File 2. Denominator and Numerator Data 


Field Name 
MCHP 
MEASURE 


DCN 
MEMBR_FIRST 
MEMBR_LAST 


DOB 
DISCHG_DATE 


SER_DATE 
SER_CODE 


CODING_TYPE 


ADMIN_HIT 
EXCLUD 
EXCLUD_REASON 


Pectormance Management 
Solutions Group on 


Acceptable Content 
Any basic text and/or numbers 
FUH 


Whole numbers only 
Any basic text 


Any basic text 

Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 


Acceptable Content 
Any basic text and/or numbers 
FUH 


Whole numbers only 
Any basic text 


Any basic text 

Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 


Any basic text and/or numbers 
C, U, or H 


Yor N 
YorN 
Any basic text and/or numbers 


Performance Management Solutions Group 


Description 
MO HealthNet Managed Care Health Plan name 
Follow-Up After Hospitalization for Mental Illness 


The Missouri Medicaid recipient identification number (not 


the MCOs internal tracking number) 
Member First Name 


Member Last Name 
Member date of birth 
First date of enrollment 


Last date of enrollment 


Description 
MO HealthNet Managed Care Health Plan name 


Follow-Up After Hospitalization for Mental Illness 
The Missouri Medicaid recipient identification number 
(not the MCOs internal tracking number) 


Member First Name 
Member Last Name 


MMember date of birth 
Date of discharge from hospitalization applicable to this 
date of service 


Date of service 


Code used to identify numerator event 

Type of coding system: C=CPT Codes; U=UB-92 
Revenue Codes; H=HCPCS Codes. 

Administrative numerator event (positive case "hit"): 
y=yes; n=no 

Was the case excluded from denominator Y=Yes; N=No 
Reason for exclusion 
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Annual Dental Visit (ADV) 
(Ad ministrative Only) 


File 1. Enrollment Data 


Performance Measures (PM) Request Documents 


Please provide all enrollment periods foreach eligible MC-++Member 
to verify continuous enrollment and enrollment gaps. 


Field Name Acceptable Content 
MCHP Any basic text and/or numbers 
MEASURE ADV 
DCN Whole numbers only 
MEMBR_ FIRST Any basic text 
MEMBR_LAST Any basic text 
Numbers only in a correct date 
DOB format (ex. mm/dd/yyyy) 


Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 


ENROLL_FIRST 


ENROLL_LAST 


File 2. Denominator and Numerator Data 


Field Name Acceptable Content 
MCHP Any basic text and/or numbers 
MEASURE ADV 
DCN Whole numbers only 
MEMBR_FIRST Any basic text 
MEMBR_LAST Any basic text 
Numbers only in a correct date 
DOB format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
SER_DATE format (ex. mm/dd/yyyy) 
SER_CODE Any basic text and/or numbers 
CODING_TYPE C, H, or | 
ADMIN_HIT Yor N 
EXCLUD YorN 


EXCLUD_REASON | Any basic text and/or numbers 


Description 
MO HealthNet Managed Care Health Plan name 


Annual Dental Visit 


The Missouri Medicaid recipient identification number (not 
the MCOs internal tracking number) 


Member First Name 


Member Last Name 
Member date of birth 
First date of enrollment 


Last date of enrollment 


Description 
MO HealthNet Managed Care Health Plan name 


Annual Dental Visit 
The Missouri Medicaid recipient identification number 
(not the MCOs internal tracking number) 


Member First Name 
Member Last Name 


Member date of birth 


Date of service 


Code used to identify numerator event 

Type of coding system: C=CPT Codes; H=HCPCS/CDT-3 
Codes*; |=ICD-9-CM Codes. 

Administrative numerator event (positive case "hit"): 
y=yes; n=no 

Was the case excluded from denominator Y=Yes; N=No 


Reason for exclusion 


* CDT is the equivalent dental version of the CPT physician procedural coding system. 
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Adolesc ent Well-Care Visits (AWC ) 


(Administrative or Hybrid) 


File 1. Enrollment Data 


Performance Measures (PM) Request Documents 


Please provide all enrollment periods foreach eligible MC-++Member 
to verify continuous enrollment and enrollment gaps. 


Field Name Acceptable Content 
MCHP Any basic text and/or numbers 
MEASURE AWC 
DCN Whole numbers only 
MEMBR_FIRST Any basic text 
MEMBR_LAST Any basic text 

Numbers only in a correct date 
DOB format (ex. mm/dd/yyyy) 


Numbers only in a correct date 
format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
format (ex. mm/dd/yyyy) 


ENROLL_FIRST 


ENROLL_LAST 


File 2. Denominator and Numerator Data 


Field Name Acceptable Content 
MCHP Any basic text and/or numbers 
Measure AWC 
DCN Whole numbers only 
MEMBR_FIRST Any basic text 
MEMBR_LAST Any basic text 
Numbers only in a correct date 
DOB format (ex. mm/dd/yyyy) 
Numbers only in a correct date 
SER_DATE format (ex. mm/dd/yyyy) 
SER_CODE Any basic text and/or numbers 
CODING _TYPE Corl 





ADMIN_HIT 


NUMERATOR_ID 


Pertormance Management 
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Description 
MO HealthNet Managed Care Health Plan name 


Adolescent Well- Care Visits 
The Missouri Medicaid recipient identification number 
(not the MCOs internal tracking number) 


Member First Name 
Member Last Name 


Member date of birth 
First date of enrollment 


Last date of enrollment 


Description 
MO HealthNet Managed Care Health Plan name 


Adolescent Well-Care Visits 
The Missouri Medicaid recipient identification number 
(not the MCOs internal tracking number) 


Member First Name 
Member Last Name 


Member date of birth 


Date of service 


Code used to identify numerator event 
Type of coding system: C=CPT Codes; |=ICD-9-CM 
Codes 


Administrative numerator event (positive case "hit"): 
y=yes; n=no 

Please indicate if this case was counted toward: 

0 = 0 visits numerator; 1 = 1 visit numerator; 
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Adolescent Well-Care (AWC) 
(Administrative or Hybrid) 


File 3. For Hybrid method ONLY - please provide a listing of the cases 
selected for medical record review. Use the following layout 


Field Name Acceptable Content Description 
MCHP Any basic text and/or numbers MO HealthNet Managed Care Health Plan name 
MEASURE AWC Adolescent Well- Care Visits 
The Missouri Medicaid recipient identification number (not 
DCN Whole numbers only the MCOs internal tracking number) 
MEMBR_ FIRST Any basic text Member First Name 
MEMBR_LAST Any basic text Member Last Name 
Numbers only in a correct date 
DOB format (ex. mm/dd/yyyy) Member date of birth 
Medical record review status: 
MR_STATUS Ror NRors R = reviewed; NR = not reviewed; S = substituted 
PROVIDER_NAME | Any basic text and/or numbers Primary Care Provider who supplied the record 
PROVIDER_ID Any basic text and/or numbers Primary Care Provider identification number 


Please see the Performance Measure Validation Submission 
Requirements and the Summary of Calculation Methods for 
Performance Measures. 
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2007 External Quality Review of the MO HealthNet Managed Care Program 


Performance Measure Validation Submission Requirements 


Insttuctions: The following listing includes relevant source data forthe EQR process. Submit paper print outs or 

photocopied itemsin the 
EQR 2007 binder supplied; use the associated tabs. Within each tab, include information specific foreach of 
the three measures forthe MO HealthNet Managed Care population. Some itemsmay not apply. For 
example, if you do not use a HEDIS vendorand perform measure calculations on site, then you may not 
have documentation on electronic record transmissions. These itemsapply to processes, personnel, 
procedures, databasesand documentation relevant to how the health plan complies with HEDIS measure 
Calculation, submission and reporting. 


If you have any questions about this request, contact Amy McCuny, EQRO Project Director, 
amccuny@pmsginfo.com. 


Check submitted Use this field to indicate whether you have submitted this information. If you are not submitting the 
particular information, please indicate “NA”. You may have submitted the content by othermeans 


eitheron the BAToraspart of some other documentation. If so, indicate “submitted”, and reference 
the document (see below). 

Name of Source Please write the name of the document you are submitting forthe item. If you are submitting pages 

Document from a procedure manual, indicate so by wniting "HEDIS submission manual, pages xx - xx." 

MCHP Comments _ Use thisspace to write out any concems you may have orany clarification that addresses any issues 
orconcems you may have regarding either the items requested or what you submitted in the 
response. 
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Reviewed By (BHC __ Thisspace will be for BHC staff use. The purpose will be fortracking what isreceived and what isnot 
use) received. It will not indicate whether the documents actually address the specific issue. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





HEDIS 2007 Data Submission Tool (MO DHSS 2007 
Table B HEDIS Data Submission Tool) forall three 
measures forthe MO HealthNet Managed Care 
Population only. Do not include other measures 
or populations. 





2007 HEDIS Audit Report. This isthe HEDIS 
Performance Audit Report forthe MO HealthNet 
Managed Care Program product line and the 
three MO HealthNet measuresto be validated 
(complete report). If the three measuresto be 
validated were not audited orif they were not 
audited forthe MO HealthNet Managed Care 
Program population, please send the report, asit 
contains Information Systems Capability 
Assessment information that can be used aspart 
of the Protocol. 








Baseline Assessment Tool (BAT) for HEDIS 2007. 
The information submitted forthe BAT will include 
descriptions of the process for calculating 
measures forthe MO HealthNet Managed Care 
Program population. 








List of cases for denominator with all HEDIS 2007 
data elements specified in the measures. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





List of cases fornumeratorss with all HEDIS 2007 
data elements specified in the measures, 
including fields for claimsdata and MOHSAIC, or 
other administrative data used. Please note that 
one of the review elements in the Protocol is: 

The “MCO/PIHP has retained copies of filesor 
databases used forperformance measure 
reporting, in the event that results need to be 
reproduced.” 





List of cases for which medical records were 
reviewed, with all HEDIS 2007 data elements 
specified in the measures. Based ona random 
sample, BHC will request health plansto gathera 
maximum of 30 records per measure and submit 
copies of the records requested to BHC. 











Sample medical record tools used if hybrid 
method(s) were utilized for HEDIS 2007 Annual 
Dental Visit, Follow-Up After Hospitalization, or 
Well-C are Visits measures for the MO HealthNet 
Managed Care Program population; and 
instructions for reviewers. 
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Tab | HEDIS Performance Measure Checkif | Name of Source MCO Comments Reviewed 
Submitted | poc ument by (BHC 
orNA use) 
8. | All worksheets, memos, minutes, documentation, 
policies and communications within the health 
plan and with HEDIS auditors regarding the 
calculation of the selected measures. 
9. | Policies, procedures, data and information used 
to produce numerators and denominators. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





10. 


Policies, procedures, and data used to 
implement sampling (if Sampling wasused). Ata 
minimum, this should include documentation to 
facilitate evaluation of: 

a. Statistical testing of resultsand any 
corections 
oradjustments made after processing. 

b. Description of sampling techniques and 
documentation that assures the reviewer 
that 
samples used for baseline and repeat 

measurements of the performance 
measures 

were chosen using the same sampling 
frame 

and methodology. 

c. Documentation of calculation forchanges 

in 

performance from previous penods (if 
Companions were made), including tests of 
statistical significance. 





it 


Policiesand procedures for mapping non- 
standard codes. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





12. 


Record and file formats and descriptions for 
entry, intermediate, and repostory files. 





13. 


Electronic transmission procedures 
documentation. (This will apply if the health plan 
sends or receives data electronically from 
vendors performing the HEDIS abstractions, 
calculations ordata entry.) 





14. 


Descriptive documentation for data entry, 
transfer, and 
manipulation of programsand processes. 





15. 





Samples of data from repository and transaction 
files to assessaccuracy and completeness of the 
transfer process. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





16. 


Documentation of properrun controls and of 
staff review of report runs. 





17. 


Documentation of results of statistical tests and 
any corrections or adjustments to data along 
with justification for such corrections or 
adjustments. 





18. 


Documentation of sources of any supporting 
extemal data orprior years’ data used in 
reporting. 





19. 





Procedures to identify, track, and link member 
enrollment by product line, product, geographic 
area, age, sex, Member months, and member 
years. 
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Tab 


HEDIS Performance Measure 


Check if 
Submitted 
orNA 


Name of Source 
Document 


MCO Comments 


Reviewed 
by (BHC 
use) 





20. 


Procedures to track individual members through 
enrollment, disenrollment, and possible re- 
enrollment. 








21. 


Procedures used to link member months to 
memberage. 





22. 


Documentation of “frozen” or archived files from 
which the samples were drawn, and if 
applicable, documentation of the MCO’s/PIHP’s 
process to re-draw a sample orobtain necessary 
replacements. 





23. 





Proceduresto capture data that may reside 
outside the 
MCO’s/PIHP’s data sets (e.g. MOHSAIC). 
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Tab | HEDIS Performance Measure Checkif | Name of Source MCO Comments Reviewed 
Submitted | poc ument by (BHC 
orNA use) 





24. | Policies, procedures, and matenals that 
evidence propertraining, supervision, and 
adequate tools for medical record abstraction 
tasks. (May include training matenal, checks of 
inter-rater reliability, etc.) 
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Performance Measures to be Calculated for MO HealthNet Members 
METHOD FOR CALCULATING HEDIS 2007 PERFORMANCE MEASURES 
Please complete this form and place in the HEDIS 2007 section of the binder supplied by BHC. Please direct 
any questions to Amy McCurry or Stephani Worts. 
MCHP 
Date Completed 
Contact Person 
Phone 


Fax 


NCQA Accredited for MC+ Product (Yes/ No) 


Certified HEDIS Software Vendor and 
Software 


Record Abstraction Vendor 


What was the reporting Date for HEDIS 2007 
Measures? 


What was the Audit Designation (Report/ No 
Report/ Not Applicable) ? 


Was the measure publicly Reported (Yes/ No)? 
Did denominator include members who 
switched MCHPs (Yes/ No)? 

Did denominator include members who 
switched product lines (Yes/ No)? 


Did the denominator include 1115 Waiver 
Members (Yes/ No)? 


Were proprietary or other codes (HCPC, NDC) 
used? 


Were exclusions calculated (Yes/ No)? 


On what date was the sample drawn? 
Were exclusions calculated (Yes/ No)? 
How many medical records were requested? 


How many medical records were received? 
How many medical records were substituted 
due to errors in sampling? 

How many medical records were substituted 
due to exclusions being measured? 
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Appendix 4 - Performance Improvement Project Request Doc uments 


Performance Improvement Project Validation 


General Instructions 


Mail All Required Information to: 


Atin: Extemal Quality Review Submission 
Behavioral Health Concepts, Inc. 

2716 Forum Bivd., Suite 4 

Columbia, MO 65203 


Due in BHC Office no laterthan: 3:00 p.m., March 3, 2008 
Please referto Performance Improvement Project Validation 


Submission Requirements and the health plan Performance 
Improvement Project Summary. 
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2007 External Quality Review of the MO HealthNet Managed Care Program 


Performance Improvement Project Validation Submission Requirements 


Instructions: The following listing includes relevant source data forthe EQR process. Submit paper 
printouts or photocopied items using the associated tabs foreach of the two 
Performance Improvement Project selected for review from the topics submitted. 
Please referto the enclosed health plan Performance Improvement Project Summary. 
Place information behind the associated cover sheet and complete the form below. 
You may also mark PIP sections if desired. Use the separate coversheets and summary 
sheets foreach PIP. 


If you have any questions about this request, contact Amy McCuny, EQRO Project Director, 
amccuny@pmsginfo.com. 


Key 

Check submitted Use this field to indicate whether you have submitted this information. If you are 
not submitting the particular information, please indicate “NA”. You may have 
submitted the content by other meansoras part of some other documentation. 
If so, indicate “submitted”, and reference the document (see below). 


Name of Source Please write the name of the document you are submitting forthe item. If you 
Document are submitting pagesfrom a procedure manual, indicate in writing. 

Health Plan Use this space to write out any concems you may have orany clanfication that 
Comments addresses any issuesorconcems you may have regarding eitherthe items 
requested or what you submitted in the response. 
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Reviewed By (BHC __ Thisspace will be for BHC staff use. The pumose will be fortracking what is 
use) received and what isnot received. It will not indicate whether the documents 
actually address the specific issue. 
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Name of 


PIP: 


Performance Improvement Project (PIP) Request Doc uments 





Tab 


Vv if 
Submitted 
orNA 


Name of Source 
Document 


MCO 
Comments 





Cover letter with clarifying information (optional) 











a. 


b. 


a 


Project narmatives, baseline measures, methods, 
interventions, and planned analyses. Examples of 
information are contained in the CMS protocols, 
Validation of Performance Improvement Projects 
and Conducting Performance Improvement 
Projects. We will be looking forthe following 
information in the Performance Improvement 
Project descriptions. 


Name and date of inception foreach 
project. 

Problem identification, including data 
collection and analysis justifying the chosen 
topic based on enrollee needs, care and 
services. 

Hypotheses 

Study question evaluation 

Selected study indicators 

Description of intervention(s) 
Methods of sampling, measurement 
Data collection procedures 

Planned analyses 

Sample tools, measures, surveys, etc. 
Baseline data source and data 
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. Improvement strategies 
m. Assessment of improvement and 
susta ina bility 




















Note: BHC may request raw data files, medical records, or additional data. 
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Measures (PM) Worksheets 


Final Performance Measure Validation Worksheet: HEDIS 2007 
Follow-up After Hospitalization for Mental Illness 


The percentage of discharges for members 6 years of age and older who were 
hospitalized for treatment of selected mental health disorders and who were seen 
on an outpatient basis or were in intermediate treatment with a mental health 


Element 


Appropriate and complete measurement plans and 
programming specifications exist that include data 
sources, programming logic, and computer source 


code. 


Age 


provider. 


Specifications 
Documentation 


Eligible Population 


6 years and older as of date of 
discharge. 


Rating Comments 





Enrollment 


Date of discharge through 30 
days. 





Gap 


No gaps in enrollment. 





Anchor date 


None. 





Benefit 


Medical and mental health 
(inpatient and outpatient) 





Event/ diagnosis 


Sampling was unbiased. 





Discharged from an inpatient 
setting of an acute care facility 
(including acute care psychiatric 
facilities) with a discharge date 
occurring on or before December 1 
of the measurement year and a 
principal |CD-9-CM diagnosis code 
indicating a mental health disorder 
specified in Table FUH-A. The 
MCO should not count discharges 
from nonacute care facilities (e.g., 
residential care or rehabilitation 
stays). 


Sampling 








Sample treated all measures independently. 





Sample size and replacement methods met 


specifications. 











ceieapaaeee Performance Management Solutions Group 


A division of Behavioral Health Concepts, Inc. 


712 


MO HealthNet Managed Care Extemal Quality Review Appendix 5 
Report of Findings - 2007 Performance Measures (PM) Worksheets 


Numerator 
Data sources used to calculate the numerator (e.g., 
member ID, claims files, medical records, provider 
files, pharmacy records, including those for members 
who received the services outside the MCOs network) 
are complete and accurate. 





Calculation of the performance measure adhered to 
the specification for all components of the numerator 
of the performance measure. 


Documentation tools used were adequate. 








Integration of administrative and medical record data 
was adequate. 
The results of the medical record review validation 
substantiate the reported numerator. 
Denominator 
Data sources used to calculate the denominator (e.g., 
claims files, medical records, provider files, pharmacy 
records) were complete and accurate. 


Xe) Leda diate) 


State specifications for reporting performance 
measures were followed. 


Estimate of Bias 
0 - 5 percentage points 
What range > 5 - 10 percentage points 
defines oe > 10 - 20 percentage points 
impact of data > 20 - 40 percentage points 
incompleteness ; 
for this > 40 percentage points 


measure? Unable to determine 


What is the 
direction of the 
bias? Overreporting 


Audit Rating 


Fully Compliant = Measure was fully compliant with State specifications. 
Substantially Compliant = Measure was substantially compliant with State 
specifications and had only minor deviations that did not significantly bias the 
reported rate. 

Not Valid = Measure deviated from State specification such that the reported rate 
was significantly biased. This designation is also assigned to measures for which no 
rate was reported, although reporting of the rate was required. 

Not Applicable = No MC+ Members qualified 

Note: 2 = Met; 0 = Not Met 
































Underreporting 
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Final Performance Measure Validation Worksheet: HEDIS 2007 
Adolescent Well-Care Visits 


The percentage of enrolled members who were 12 - 21 years of age and who had at 
least one comprehensive well-care visit with a primary care practitioner or an 
OB/GYN during the measurement year. 


Element Specifications Rating Comments 


Documentation 
Appropriate and complete measurement plans and 
programming specifications exist that include data 
sources, programming logic, and computer source 
code. 


Eligible Population 


12 -21 years as of December 31, 
Age 2006. 


Enrollment Continuous during 2006. 

No more than one gap in 
enrollment of up to 45 days during 
the continuous enrollment period. 
To determine continuous 
enrollment for an MC+ beneficiary 
for whom enrollment is verified 
monthly, the member may not 
have more than a 1-month gap in 
Gap coverage. 


Anchor date Enrolled as of December 31, 2006. 
Benefit Medical 
Event/diagnosis | None 




















Sampling 


Sampling was unbiased. 





Sample treated all measures independently. 





Sample size and replacement methods met 
specifications. 





Numerator 
Data sources used to calculate the numerator (e.g., 
member ID, claims files, medical records, provider 
files, pharmacy records, including those for members 
who received the services outside the MCOs network) 
are complete and accurate. 





Calculation of the performance measure adhered to 
the specification for all components of the numerator 
of the performance measure. 





Documentation tools used were adequate. 





Integration of administrative and medical record data 
was adequate. 
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The results of the medical record review validation 
substantiate the reported numerator. 


Dl=yaleo =hae 
Data sources used to calculate the denominator (e.g., 


claims files, medical records, provider files, pharmacy 
records) were complete and accurate. 





=jeleo) « e 
State specifications for reporting performance 
measures were followed. 


























0 - 5 percentage points 
What range > 5 - 10 percentage points 
defines the > 10 - 20 percentage points 
Impact eieaka > 20 - 40 percentage points 
incompleteness : 
for this > 40 percentage points 
measure? Unable to determine 
What is the Underreporting 
direction of the 
bias? Overreporting 








a e at: e 


Fully Compliant = Measure was fully compliant with State specifications. 
Substantially Compliant = Measure was substantially compliant with State 
specifications and had only minor deviations that did not significantly bias the 
reported rate. 

Not Valid = Measure deviated from State specification such that the reported rate 
was Significantly biased. This designation is also assigned to measures for which no 
rate was reported, although reporting of the rate was required. 


Not Applicable = No MC+ Members qualified 
Note: 2 = Met; 0 = Not Met 
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Final Performance Measure Validation Worksheet: HEDIS 2007 
Annual Dental Visit 
The percentage of enrolled MC+ Managed Care Program Members who were 2 -21 
years of age who had at least one dental visit during the measurement year. This 
measure applies only if dental care is a covered benefit in the MCO's Medicaid 
contract. 


Element Specifications st Lalare| Comments 
Documentation 
Appropriate and complete measurement plans and 
programming specifications exist that include data 
sources, programming logic, and computer source 
code. 
Eligible Population 


2 -21 years of age as of 
December 31, 2006. The 
measure is reported for 
each of the following age 
stratifications and as a 
combined rate: 

* 2 -3 year-olds 

* 4 -6 year-olds 

7-10 year-olds 

11 - 14 year-olds 

15 - 18 year-olds 

19 - 21 year-olds 


Enrollment Continuous during 2006 

No more than one gap in 
enrollment of up to 45 days 
during 2006. To determine 
continuous enrollment for 
an MC+ beneficiary for 
whom enrollment is verified 
monthly, the member may 
not have more than a 1- 
Gap month gap in coverage. 
Enrolled as of December 31, 
Anchor date 2006 


Benefit Medical 
Event/ diagnosis None 
Sampling - Not Applicable to this measure, calculated via 
Administrative calculation methodology only 


* 
* 
* 
* 


Age 
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Data sources used to calculate the numerator (e.g., 
member ID, claims files, medical records, provider 
files, pharmacy records, including those for 
members who received the services outside the 
MCOs network) are complete and accurate. 





Calculation of the performance measure adhered to 
the specification for all components of the numerator 
of the performance measure. 


Data sources used to calculate the denominator 
(e.g., claims files, medical records, provider files, 
harmacy records) were complete and accurate. 


State specifications for reporting performance 
measures were followed. 





0 - 5 percentage points 





> 5 - 10 percentage points 








; > 10 - 20 percentage points 
What range defines 





the impact of data > 20 - 40 percentage points 
incompleteness for > 40 percentage points 





this measure? Unable to determine 


Underreporting 





What is the direction 
of the bias? Overreportin 














4 e at: e 


Fully Compliant = Measure was fully compliant with State specifications. 
Substantially Compliant = Measure was substantially compliant with State 
specifications and had only minor deviations that did not significantly bias the 
reported rate. 

Not Valid = Measure deviated from State specification such that the reported rate 
was significantly biased. This designation is also assigned to measures for which no 
rate was reported, although reporting of the rate was required. 

Not Applicable = No MC+ Members qualified 


Note: 2 = Met; 0 = Not Met 
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Appendix 6 - Encounter Data Minimum Criteria 


Recommended Encounter Data Validation Criteria 


Data Element 


Enrollee 1D 


Principal Diagnosis 


Date of Service 


Unit of Service (Quantity) 


Procedure Code 


Expectation 


Should be valid as 
found in the State's 
eligibility file. 


Well-coded lead- 
related diagnoses 
(or well-child visit) 


Dates should be 
evenly distributed 
across time 


The number should 
be routinely coded. 


This is a critical 
element and should 
always be coded. 
Will be assessed 
only for presence of 
code except for 
lead-related codes 
which will be 
validated with 
medical records. 


WEN Cet aVat el gi <-1a re) 


100% valid 


> 90% non-missing and valid 
codes. 


If looking at a full year of data 
5-7% of the records should be 
distributed across each month. 


98% non-zero 

<70% should be one if CTP 
code in range of 99200-99215, 
99241-99291 


99% present (not zero, blank, 
8- or 9-filled). 100% should be 
valid, State-approved codes. 
There should be a wide range of 
procedures with the same 
frequency as previously 
encountered. 





Source: Medstat (1999). A Guide for States to Assist in the Collection and Analysis of 
Medicaid Managed Care Data:: Second Edition 
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Appendix 7 - Encounter Data Request Doc uments 


Encounter Data Validation Submission Instructions 


Mail To: 


Behavioral Health Concepts, Inc. 
Attn: Amy McCuny Schwartz 
2716 Forum Blvd., Suite 4 
Columbia, MO 65203 


Label the package CONADENTIAL 
Due Date (due in BHC’s offices by close of business): Friday, May 4, 2007 


General data submission instructions 

Data file formats all need to be ASCII, and readable in Microsoft 
Windows environment. Use an appropnate delimiter (e.g., @) for 
data that may contain commasor quotation marks. Ensure that date 
fields either contain a null value ora valid date. Make all submissions 
using compact disk (CD) formats and mail it to BHC, Inc. No files will 
be accepted via e-mail. Ensure that fileson the CD are accessible on 
a Microsoft Windows workstation priorto submitting. 


Specific data submission instructions 


Please provide documentation foreach electronic file being 
submitted. 
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Encounter Data Request 


There should be 4 files submitted to BHC: 


1. File 1: Mailing addressand contact of the provider 
associated with each Intemal Control Number (ICN) for 
sampled claims (service dates] uly 1, 2006 to 
September 30, 2006). Although MC+Managed Care 
Organizations willbe doing medical record requests, 
BHC need to have detailed provider information for 


tracking purposes. 


2. File 2: Allinpatient encounters from J uly 1, 2006 to 
September 30, 2006 for selected recipients, with detailed 
provider information. Please submit file using the following 









































layout. 
Field Name Content Description 
ICLAIM_TYPE Claim type: 
| = Inpatient 
ICLAIM_STATUS P=Paid 
U=Unpaid 
D=Denied 
IICN . 
State assigned Internal Control Number (ICN) 
|PAID- AMT 
This field indicates the amount of money paid 
to the hospital for the billed services. 
|RECIP-ID 
The Missouri Medicaid recipient identification 
number. 
ILAST ms 
Recipient last name 
IFIRST ae : 
Recipient first name 
IACCT_NUM The recipient's account number used by the 
doctor's office. 
|ADMIT_TYPE 
Admission Type 
The only valid values are: 
1 = Emergency 
2 = Urgent 
3 = Elective 
4 = Newborn 
G sanha ibe Bers Performance Management Solutions Group 720 
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9 = Information Not Available 

















|ADM_DT ne 
= The date the recipient was admitted to the 
hospital. This date cannot exceed the current 
date. 
IDSCH_DT = : 
= The date the recipient was discharged from the 
hospital. If the patient is still in the hospital, 
the latest date of service that applies to the 
claim. 
IBILL_TYPE 
- Valid bill type codes are: 
Inpatient 
11x 
12x 
18x 
Outpatient 
13x 
14x 
71x (Rural Health) 
81x (Hospice) 
82x (Hospice) 
Home Health 
30x 
31x 
32x 
33x 
34X 
35x 
36x 
37x 
38x 
39x 
ISTAT 





The code that represents the condition under 
which the recipient was discharged. 
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01 Home 

02 Hospital 

03 Skilled Nursing Facility (SNF) 
04 Intermediate Care Facility (1CF) 
05 Institution (Inst) 

06 Home Health Agency (HHA) 

07 Left 

08 Other 

20 Death 

30 Still A Patient 

50 Discharge from Hospice to Home 


51 Discharge from Hospice to Another 
Medical Facility 


62 Discharged/transferred to an 
inpatient rehabilitation facility (IRF) 
including rehabilitation distinct part 
units of a hospital 


64 Discharged/transferred to a nursing 
facility certified under Medicaid but not 
certified under Medicare 


65 Discharged/transferred to a 
psychiatric hospital or psychiatric 
distinct part unit of a hospital 




















IPROV_NUM 
Z The Health Plan’s 9-digit provider number. 
IPRIM_DX ee ; : ‘ 
a The recipient's primary diagnosis. Decimal 
points are implied. 
IDX_2 : . : j 
= Second diagnosis. Decimal points are implied. 
IDX_3 
- Third diagnosis. Decimal points are implied. 
IDX_4 
= Fourth diagnosis. Decimal points are implied. 
IDX_5 


Fifth diagnosis. Decimal points are implied. 








IKEY A code that indicates the patient has other 
insurance that may or may not be reflected on 
the claim. Valid values are: 

1 = Yes, patient has other insurance. 

2 = Yes, patient has other insurance not 
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reflected on this bill. 
3 = No, patient does not have other insurance. 





IFDT_SVC 


The date that the billing period begins. 





ILDT_SVC 


The date that the billing period ends. 





IREVENUE_CD 


The three-digit code from 100 to 999 that 
represents the services that are billed on this 
particular line item. The combined total 
number of accommodation and ancillary 
services billed cannot exceed 28 lines per 
claim. 


Accommodation revenue codes range from 10X 
through 21X. Ancillary revenue codes range 
from 22X through 99X. 


NOTE: Emergency Room (rev 450 and 459) 
and Ambulance (rev 540 to 549) may only be 
billed as inpatient if the patient is admitted to 
the hospital. 








IUNITS_ SVC 


The number of days per room rate for both 
covered and non-covered accommodations 
(revenue codes 100 through 239). Whole 
numbers only are accepted for the days. 








3. File 3: All outpatient encounters (Outpatient, Medical, 
Dental, and Home Health) from J uly 1, 2006 to 
September 30, 2006 for selected recipients, with 
detailed provider information. Please submit file using 
the following layout. 





Field Name 


Content Description 





OCLAIM_TYPE 


O=Outpatient 
M=Medical 
L=Dental 
H=Home Health 





OCLAIM-STATUS 


Claim Type: O, M, L, H 
P=Paid 

U=Unpaid 

D=Denied 





OILCN 


State assigned Internal Control Number (ICN) 





OPAID_AMT 


Claim Type O, M, L, H 
This field is informational only and reflects what FFS 
would pay. 








ORECIP_ID 





Claim Type: O, M, L, H 
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The Missouri Medicaid recipient identification number. 
































OLAST 
Claim Type: O, M, L, H 
Recipient last name 
OFIRST ; 
Claim Type: O, M, L, H 
Recipient first name 
OACCT_NUM Claim Type: O, M, L, H 
The recipient's account number used by the doctor's 
office. This field may be left blank or used for other 
purposes, such as the Health Plan Claim Internal Control 
Number. 
OPROV_NUM 
~ Claim Type: O, M, L, H 
The Health Plan’s 9 digit provider number. 
OPRIM_DX Claim Type: O, M, L, H 
The ICD-9 diagnosis code of the recipient's diagnosis. 
Any decimal point needed in the diagnosis code is 
implied and should not be included. 
ODX_2 Claim Type: O, M, L, H 
Second diagnosis. The |CD-9 diagnosis code of the 
recipient's diagnosis. Any decimal point needed in the 
diagnosis code is implied and should not be included. 
ODX_3 Claim Type: O, M, L, H 
Third diagnosis. The |CD-9 diagnosis code of the 
recipient's diagnosis. Any decimal point needed in the 
diagnosis code is implied and should not be included. 
ODX_4 Claim Type: O, M, L, H 
Fourth diagnosis. The ICD-9 diagnosis code of the 
recipient's diagnosis. Any decimal point needed in the 
diagnosis code is implied and should not be included. 
ODX_5 Claim Type: O, M, L, H 
Fifth diagnosis. The |CD-9 diagnosis code of the 
recipient's diagnosis. Any decimal point needed in the 
diagnosis code is implied and should not be included. 
O_KEY Claim Type: O, M, L, H 


A code that indicates the patient has other insurance 
that may or may not be reflected on the claim. Valid 
values are: 

0 = No, patient does not have other insurance. 

1 = Yes, patient has other insurance. 

2 = Yes, patient has other insurance not reflected on 
this bill. 








OFIRSTDT_SVC 


Claim Type: O, M, L, H 
This is the first date the service was performed. This 
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date cannot exceed the current date. 





OLASTDT_SVC 


Claim Type: O, M, L, H 
This is the last date the service was performed. This 
date cannot exceed the current date. 








OPLACE_SVC 





Claim Type: M, L 


C-14 PLACE OF SERVICE 

03 School 

04 Homeless Shelter 

05 Indian Health Service Free-Standing Facility 
06 Indian Health Service Provider-Based Facility 
07 Tribal 638 Free-Standing Facility 

08 Tribal 638 Provider- Based Facility 

11 Office 

12 Home 

13 Assisted Living Facility 

14 Group Home 

15 Mobile Unit 

20 Urgent Care Facility 

21 Inpatient Hospital 

22 Outpatient Hospital 

23 Emergency Room - Hospital 

24 Ambulatory Surgical Center 

25 Birthing Center 

26 Military Treatment Facility 

31 Skilled Nursing Facility 

32 Nursing Facility 

33 Custodial Care Facility 

34 Hospice 

41 Ambulance - Land 

42 Ambulance - Air or Water 

49 Independent Clinic 

50 Federally Qualified Health Center (FQHC) 

51 Inpatient Psychiatric Facility 

52 Psychiatric Facility - Partial Hospitalization 
53 Community Mental Health Center 

54 Intermediate Care Facility/Mentally Retarded 
55 Residence Substance Abuse Treatment Facility 
56 Psychiatric Residential Treatment Facility 

57 Non-Residential Substance Abuse Treatment Facility 
60 Mass Immunization Center 

61 Comprehensive Inpatient Rehabilitation Facility 
62 Comprehensive Outpatient Rehabilitation Facility 
65 End Stage Renal Disease Treatment Facility 
71 State or Local Public Health Clinic 

72 Rural Health Clinic 

81 Independent Laboratory 

97 Parochial/Private Schools 

98 Schools 

99 Other Unlisted Facility 


Claim Type: O, H 
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Not applicable 

OUTPAT-UNITS- Claim Type: O, M, L, H 

SVC The number of units of services performed. Whole 
numbers only. 

ODTL-PROC Claim Type: M, L, H 
The procedure code that represents the service 
preformed. 
Claim Type: O 


For outpatient claims, a procedure code is required only 
when the revenue code range for outpatient services is 
300 through 319. This revenue code range represents 
laboratory services. The appropriate CPT procedure code 
range for laboratory services is 80048 through 89399. 
All other outpatient services must be designated by 
revenue code. 











ODTL-PROC-MOD-P Claim Type: O, M, L, H 

The 2-digit modifier that applies to the service provided. 
ODTL-PROC-MOD-| Claim Type: O, M, L, H 

The 2-digit modifier that applies to the service provided. 
ODTL-DIAG-CODE Claim Type: O, M, L, H 


The diagnosis code of the recipient's diagnosis. Decimal 
points are implied. 








OREVENUE_CD Claim Type: O 

The three digit code from 100 to 999 which represents 
the services that are billed on this particular line item. A 
revenue code is required on all Outpatient claims. For 
those revenue codes representing lab services (300- 
319), a procedure code must also be submitted. 


Claim Type: M, L, H 
Not applicable 








4. File 4: Allpharmacy encounters from J uly 1, 2006 to 
September 30, 2006 for selected recipients, with 
detailed provider information. Please submit file using 
the following layout. 





























Field Name Content Description 
PH_TRANSACTION-CD This field shows the number of claims being billed on 
the record. Valid values are: 
01 - 1 Claim 
02 - 2 Claims 
03 - 3 Claims 
04 - 4 Claims (maximum) 
PHCLAIM_STATUS P=Paid 
U=Unpaid 
D=Denied 
PHICN State assigned Internal Control Number (ICN) 
PH PROV-NUM The Health Plan’s 9-digit provider number 
PH _NABP-NUM This field will always contain the 7-digit National 
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Association of Boards of Pharmacy (NABP) 
identification number assigned to the pharmacy. The 
NABP number must be in the first 7 positions of the 9- 
digit field (left justified). 








PHRECIP_ID The Missouri Medicaid recipient identification number. 

PHKEY A code that indicates the patient has other insurance 
that may or may not be reflected on the claim. Valid 
values are: 


0 = No, patient does not have other insurance. 

1 = Yes, patient has other insurance. 

2 = Yes, patient has other insurance not reflected on 
this bill. 





PH_FIRST-DT-SVC The dispense date. 





PH_LAST 
7 Entire name may be entered. Only the first two letters 


of the recipient's last name and the first letter of the 
recipient's first name will be verified against the 
recipient's Medicaid enrollment records. The plan 
must send a minimum of two characters for the last 
name and one character for the first name. 





PH_FIRST 
- Entire name may be entered. Only the first two letters 


of the recipient's last name and the first letter of the 
recipient's first name will be verified against the 
recipient's Medicaid enrollment records. The plan 
must send a minimum of two characters for the last 
name and one character for the first name. 





PH_PRESCRI P-NUM The prescription number of the prescription filled or 
refilled. 





PHREFILL-IND The only valid values are: 
Original - 00 (zero) 
Refill - 01-99 





PHDRUG-QTY The metric or non-metric quantity of the drug being 
dispensed. For example: A quantity of 100 would be 
0100. 





PHDAYS-SUPPLY The estimated number of days the dispensed amount 
represents. A days supply greater than 365 is invalid. 





PHCOMPOUND-IND An indicator identifying the prescription as a non- 
compound or as an ingredient of a compound 
prescription. 

A value of '0' or '1' is used to indicate non-compound 
prescriptions or the FIRST ingredient of a compound 
prescription. A value of '2' is used to indicate any 
additional ingredients of a compound prescription. 





PHARM-DRUG-NDC-CODE The National Drug Code designated for the drug 
dispensed. The field is 5-4-2 format no hyphens or 
spaces 








PHPROV-NUM The Medicaid, DEA number, or name of the 
prescribing physician. If not available, enter the 
dispensing pharmacy NABP number unless you are a 








pharmacy having FQHC status. 
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PHEPSDT-IND A code indicating whether or not a drug was 
dispensed to a recipient under the Early Periodic 
Screening and Diagnostic Treatment (EPSDT) 
program. Y = yes 
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Appendix 8 - Medical Record (MR) Request Letters 
PERFORMANCE MEASURES MR REQUEST LETTER 


Behavioral Health Concepts, Inc. 
Victoria Park, 2716 Forum Bivd., Suite 4, Columbia, MO 65203 (573) 446-0405 
A (573) 446-1816 (fax) 


(866) 463-6242 (toll-free) 
www.bhcinfo.com 


February 13, 2008 


Subject 2007 Extemal Quality Review Performance Measure Validation 
Protoc ol Medical Records Request (hybrid methodology only). 


Due Date: March 24, 2008 


Dear <...>, 


We have reviewed <MCHP Name>s HEDIS 2007 Adolescent Well Care 
Measure. 


Please find attached a file containing a listing of the casesrelated to this 
HEDIS Measure that have been selected for medical record review. 
Behavioral Health Concepts, Inc. (BHC) requests copies of all medical 
records for these sampled cases. Each medical record supplied should 
contain all the information that contributed to the numerator forthe given 
HEDIS 2007 Measure. Please forward copies of these medical records to 
BHC atthe address listed above, and mark the package asconfidential. 


If you have any questions, please contact BHC’s Extemal Quality Review 
team at (573) 446-0405 orvia e-mail: amccurry@bhcinfo.com 


Thank you, 


Amy McCuny Schwartz 
EQRO Project Director 


Attachment: 
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1) File containing a sample of casesfor medical record review 


cc: Ms. Susan Eggen, Assistant Deputy Director, MO HealthNet Division, 
Missoun Department of Social Services 
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ENCOUNTER DATA MR REQUEST LETTER 


Behavioral Health Concepts, Inc. 
Victoria Park, 2716 Forum Blvd., Suite 4, Columbia, MO 65203 (573) 446-0405 
fe (573) 446-1816 (fax) 


(866) 463-6242 (toll-free) 
www.bhcinfo.com 


March 3, 2008 


Re: 2007 Extemal Quality Review Encounter Data Validation Protocol 


DearMO HealthNet Managed Care Health Plan Encounter Data 
Validation Contact: 


As discussed with MCO staff during the 2007 EQR onrentation meeting over 
teleconference, BHC is requesting the following information for Encounter 
Data Validation from each health plan: 


5. File 1: Mailing addressand contact information of 
provider associated with each Intemal Control 
Number (ICN) forthe sampled claims (service dates 
J uly 1, 2007 to September 30, 2007). BHC requires this 
information fortracking purposes. Due date: March 
17, 2008. 


Enclosed isa CD-ROM containing a file of the sample of encounters. This 
file contains claim ICNs (Intemal Control Number) and patient identifying 
information. Please use thissample to request medical records from 
providers. The password forthis CD-ROM iscontained in the email | sent to 
you with the subject line: 2007 Encounter Data Request. 


We are allowing up to seven business days for preparation of the medical 
record requests. The requests must be submitted to providers by March 
24, 2008. This will allow the providers 5 weeks to gather records. Providers 
should supply records directly to BHC, Inc. by Apnil 28, 2008. 


MO HealthNet Managed Care Health Plansare extended an additional 
week to submit records that are collected from providers. Records not 
received by May 5, 2008 will be considered undocumented encounters. 
Please be advised that BHC and/orMO HealthNet Division do not provide 
reimbursement for the cost of photocopying or mailing records. 
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During the past four years BHC provided a status report to MCHPs 
indicating the submission rate of recordsduring the collection process. This 
practice isintended to facilitate a higherretum rate. In orderto provide 
this service, BHC must obtain requested provider information. Please 
retum provider contact information to BHC, in the requested format, by 
March 17, 2008. 


To assist with the medical record request process, we have also enclosed 
medical records submission instructions, and a letter from Sandra Levels 
detailing information regarding federal and state requirements for 
adherence to HIPAA and the Extemal Quality Review. 


If you have any questions, please contact BHC’s Extemal Quality Review 
team at 573-446-0405. 


Thank you, 


Amy McCuny Schwartz, Esq., MHSA 
EQRO Project Director 


Encl: 


Encounter Data Validation Submission Instructions 

Medical Records Submission Instructions 

Letter from Sandra Levels 

CD-ROM with sample of encounters for encounter data validation 


PONP 


CC: 
Ms. Susan Eggen, Assistant Deputy Director, MO HealthNet Managed Care, Missouri 
Department of Social Services, Division of MO HealthNet 


ean Group 
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Appendix 9 - Table of Contents for Medical Record Training Manual 
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Appendix 10 - Abstraction Tools 


ENCOUNTER DATA MEDICAL RECORD ABSTRACTION TOOL 


Medical Record Abstraction Tool 


















































Primary 

Record ID Key 
Patient Name OUTPAT_RECIP_LAST_NAME OUTPAT_RECIP_FIRST_NAME 
Date of Birth OUTPAT_RECIP_BIRTHDATE 
Patient DCN OUTPAT_PROCESSED_RECIP_ID 
Provider Name FIELD 
Clinic Name FIELD 
Clinic Address 
First Date of Service FIELD 
Abstractor I nitials 

m m d d y y y y 
Date of abstraction 
Data entry operator initials 

h h m m 
Start Time 




















Examine only the information provided in physician and professional documentation. DO 
NOT use the CMS-1500, any claim forms, or any claim histories. 





Medical Record 


















































Match EErOr 
Element Comparison Type 
OUTPAT_FIRST_DT_SVC oi 
= only 
Nol 1, 8, 
7 =Yes | 9, or 
Date of Service m m d d y y y y 0 
Missing = 99999999 
Comment (Required if Error Type = Other) 
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Primary Diagnosis OUTPAT_DX_1 ate 
= only 
Nol 1, 3, 
=Yes | 8, 9, 
Decimal is implied. Start at left. If only 3 or 4 digits, leave the right spaces blank. or 0 
Missing = 99999 
Comment (Required if Error Type = Other) 
= Code 
a only 
Nol 8, 9, 
= Yes 
or O 


DX_DESCRIPTION 





Primary Diagnosis 
Description 














Comment (Add description from medical record; Required if Error Type = Other) 





Patient Name OUTPAT_RECIP_LAST_NAME OUTPAT_RECIP_FIRST_NAME 
Date of Birth OUTPAT_RECIP_BIRTHDATE 
Patient DCN OUTPAT_PROCESSED_RECIP_ID 


Element Code 





Procedure Code To be coded by reviewer 





Decimal is implied. Start at left. If only 3 or 4 digits, leave the right spaces blank. 




















Not Enough Information = 22222 
Comment (Required if Error Type = Other) 








To be coded by reviewer 








Procedure Description 





Comment (Add description from medical record; Required if Error Type = Other) 
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Referrals Documented in the Medical Record (check all that apply; only if not 
related to the claim validated) 


None (0) 
Laboratory (1) 





Pharmacy (2) 


Specialist (3) 


Radiology (4) 
Other (5) 
List 





See next page for the procedure code and procedure code description to be 
validated. 


Does the medical record documentation adequately support the procedure code 
and description? 


L) Yes (1) 
L) No (0) 
If no, Reason (check only one): 


Not enough information (e.g., the date of service and 
information are present, but there is not enough 





U) information to make a determination) (1) 

L) Upcoded (2) 

Q) Incorrect (3) 

LJ Missing (9) 

Q) Other (4). 
Comment 
Patient Name OUTPAT_RECIP_LAST_NAME OUTPAT_RECIP_FIRST_NAME 
Date of Birth OUTPAT_RECIP_BIRTHDATE 
Patient DCN OUTPAT_PROCESSED_RECIP_ID 


Examine the CMS-1500 or any claim forms. If there is no claim form or history, code as 
missing. 
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Claim Form or History 





Element Comparison 





OUTPAT_ FIRST DT SVC 





Date of Service 


























Missing = 99999999 











Comment (Required if Error Type = Other) 








Primary Diagnosis OUTPAT_DX_1 





Decimal is implied. Start at left. If only 3 or 4 digits, leave the right spaces blank. 




















Missing = 99999 
Comment (Required if Error Type = Other) 














DX_DESCRIPTION 





Primary Diagnosis 
Description 











Comment (Required if Error Type = Other) 





OUTPAT_DTL_PROC 





Procedure Code 
Comment (Required if Error Type = Other) 
































OUPT_DESCR 








Procedure Description 








Comment (Required if Error Type = Other) 
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End Time 




















Medical record protocols 
Abstraction tool 


Need to preprint selected encounters to be validated, with primary diagnosis and CPT code 
Need spaces for additional encounters 

Record referrals, prescriptions, and lab procedures 

Experienced clinical coders 


Requests 

Docs need to include billing information, i.e., primary diagnosis code, CPT code, etc. 

June 1, 2006 to September 1, 2006 

All documentation of encounter claim data, to include progress notes, lab sheets, referrals, 
prescriptions, flow sheets, forms, and dates of services. 

Provider identification number, place of service, etc.. 

Photocopy of claim form 

Printout of electronic medical record 


notes 
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PERFORMANCE MEASURES MEDICAL RECORD ABSTRACTION TOOL - AWC 


Adolescent Well-Care Visits (AWC) Abstraction Tool 


Patient Name 


















































































































































































































































Last 
First 
m m d d y yyy 
Date of Birth 
Missing = 11119999 
Provider Name | 
Last 
First 
Name of MCHP C) Mercy CarePlus (1) L) Family Health Partners (5) 
(Check only 
one) L) HealthCare USA (2) (1 Blue-Advantage Plus (6) 
CQ) Harmony Health Plan (3) 
L) Missouri Care (4) 
Abstractor 
Initials 
m m d d y sy 
Date of 
abstraction 
Data entry 
operator 
initials 
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Abstraction Tools 








Start Time 

















Search the medical record for a well care visit during the calendar year 


Source of 
Documentation: 


Documented 


Components 
of Well Care 
Visit: 
(Check all that 
apply) 


Date of Well Care Visit 


UL) Medical Record (1) 
LL) Claim Form (2) 

QO) Both (3) 

L) None (0) 


Health and Developmental History 


LU) Yes (1) 

LI No (0) 

Physical Exam 

LU) Yes (1) 

LI No (0) 

Anticipatory Guidance 

LU) Yes (1) 

LI No (0) 

m m d dy _y y y 





Unless ALL components 





above are checked, code 





























Missing = 11119999 


Acceptable Procedure Codes: 





Procedure Code 


























Missing = 99999 
Insufficient Information = 22222 
Don't Know = 88888 


99383, 99384, 99385, 99393, 
99394, 99395 


See list to the right of Procedure Codes. Does procedure code match one of 














these? Acceptable Diagnosis Codes: 
Procedure Code Match QO) Yes (1) V20.2 V70.5 V70.9 
QO No (0) V70.0 V70.6 
V70.3 V70.8 
Cé=— Performance Management Solutions Group 740 
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Diagnosis Code Notes: 





Decimal is implied. Start at left. If only 3 or 4 digits, 
leave the right spaces blank. 


Missing = 99999 























Insufficient Information = 22222 
Don't Know = 88888 











Diagnosis Code O) Yes (1) 
Match QO) No (0) 

h h m om 
End Time 























Were three Hep Bs completed by the members’ 13th birthday? 


Was one dose of the two-dose regimen and 2 other doses of Hep B completed by the 
members’ 13th birthday? 
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Appendix 11 - Agenda for Site Visits 


PAU 


Missouri MC+ 
WE War-Wel-xe Mm Or- Va eam ea gelee- Wii) 


External Quality 
Review 





SITE VISIT AGENDA 


Luly 23, 2008 -- Morning 
[| TIME |ACTIVITIY ~———C<dL ATTENDEES ~—S[ LOCATION —_s—”/ 


8:30 - 9:00 Introduction - Opening BHC, Inc. - 
Amy McCurry 
Schwartz 
Mona Prater 
Myrna Bruning 
Stephani Worts 


Healthplan Attendees 


9:00 - 10:30 | Compliance Review —Interviews BHC, Inc. - 
with Member Services Staff Mona Prater 
Myrna Bruning 
Amy McCurry 
Schwartz 


Healthplan Attendees 
- Member Services 
Staff 


}10:30- 10:45 | Break-OrderLunch | 
10:45 - 12:45 | Compliance Review - Care BHC, Inc. - 
Management Interviews Mona Prater 
Myrna Bruning 


Healthplan Care/Case 
Managers 


Performance Management Solutions Group 
A division of Behavioral Health Concepts, Inc. 





MO HealthNet Managed Care Extemal Quality Review Appendix 11 
Report of Findings - 2007 Agenda for Site Visits 


9:00- 11:30 | Validation of Performance 
Measures - Amy McCurry 
Interviews Schwartz 
Stephani Worts 


Information Systems Capabilities 
Assessment - Interviews Healthplan Attendees 


Document Review - May require 
access to computers and 
individuals who can answer 
questions and access data files 
that produce the HEDIS measures. 





Afternoon 


ali ——< aN il 
Reviewer Meeting 
1:30 - 2:30 Compliance Review - BHC, Inc. - 

Interviews with Administrative Amy McCurry 

Staff Schwartz 


Mona Prater 
Myrna Bruning 


Healthplan Attendees 


[2:30-2:45 [Break | 
2:45 - 3:45 Validation of Performance BHC, Inc. - 
Improvement Projects Amy McCurry 
Schwartz 
Mona Prater 
Myrna Bruning 


Healthplan Attendees 


|3:45- 4:00 | Exit Conference Preparation | BHC, Inc. Staff. | 
4:00 - 4:30 Exit Conference BHC, Inc. -- 
Amy McCurry 
Schwartz 
Mona Prater 
Myrna Bruning 
Stephani Worts 





Healthplan Attendees 
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Report of Findings - 


2007 


Appendix 12 - Compliance Review Scoring Form 
2007 BHC MO HealthNet Managed Care Health Plan Compliance Review Scoring Form 


This document is used to score the number of items met for each regulation by the health plan. 


1. Review all available documents prior to the site visit. 


2. Follow-up on incomplete items during the site visit. 
3. Use this form and the findings of Interviews and all completed protocols to complete the 


Documentation and Reporting Tool and rate the extent to which each regulation is met, partially met, 


or not met. 


Scores from this form will be used to compare document compliance across all health plans. 


0 = Not Met: Compliance with federal regulations could not be validated. 
1 = Partially Met: Health Plan practice or documentation indicating compliance was observed, but 


total compliance could not be validated. 


2 = Met: Documentation is complete, and on-site review produced evidence that health plan 


practice met the standard of compliance with federal regulations. 





2006 Rating 
0 = Not Met 
1 = Partially 


2007 Rating 
0 = Not Met 
1 = Partially 












































~~ 


A division of Behavioral Health Concepts, Inc. 


Contract 2007 Site Visitand | Met Met 
Compliance Tool | Federal Regulation | Description Comments Findings 2=Met 2 = Met 
Subpart C: Enrollee Rights and Protections 
2.6.1(a)1-25, Enrollee Rights: 
1 | 2.2.6(a), 2.6.2(j) | 438.100(a) General Rule 
2.6.1(a)1, 2.9, Enrollee Rights: 
2 | 2.6.2(j), 2.6.2(n) | 438.10(b) Basic Rule 
Alternative 
Language: 
Prevalent 
3 | 2.15.2(e), 2.8.2 438.10(c)(3) Languages 
Language and 
2.8.2, 2.8.3, format: Interpreter 
A | 2.6.2(n)(2) 438.10(c)(4,5) Services 
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Compliance Review Scoring Form 






































Information 
Requirements: 
2.6.1(a)1, Alternative 
5 | 2.6.2(n)1 438.10(d)(1)(i) Formats 
2.6.1(a)1, 
2.6.2(n)2 - dot Information 
point 35, 2.6.2(q), | 438.10(d)(1)(iijand | Requirements: 
6 | 2.8.2, 2.8.3 (2) Easily Understood 
2.3.5, 
2.6.1(a)2/3, 
2.6.2(k)1, 
2.6.2(n), Enrollee Rights: 
2.6.2(n)(2), Information, Free 
7 | 2.6.2(q) 438.10(f) Choice 
Information to 
Enrollees: 
Physician Incentive 
8 | 2.6.2(n)(2) 438.10 (g) Plans 
2.4, 2.4.5, 
2.4.5(a)2-4, Liability for 
2.20.1(all), Payment and Cost 
9 | 3.5.3(f) 438.10(i) Sharing 
Specific Enrollee 
2.2.6(a), 2.2.6(b), Rights: Provider- 
2.6.1(a)(3), Enrollee 
10 | 2.6.2(j), 2.9.1 438.100(b)(2)(iii) Communications 
Right to Services, 
including right of 
2.6.2(j), 2.30.1, refusal. Advance 
11 | 2.30.2, 2.30.3 438.100(b)(2)(iv,v) | Directives 
2.6.2(j), 2.4.8, 
12 | 2.13, 2.14 438.100(b)(3) Right to Services 
Compliance with 
2.2.6, 2.14.3, Other State 
13 | 2.14.8, 2.14.9 438.100(d) Requirements 
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Total Enrollee Rights and Protections | | 





Subpart D: Quality Assessment and Performance Improvement 





Subpart D: Quality Assessment and Performance Improvement: Access Standards 





2.3.1, 2.6.2(j), 
2.14.3, 2.7.1(g), 


Availability of 
Services: Provider 





















































14 | 3.5.3 438.206(b)(1)(i-v) Network 
Access to Well 
2.7.1(e), 2.7.1(f), Woman Care: 
15 | 2.14.8 438.206(b)(2) Direct Access 
16 | 2.13 438.206(b)(3) Second Opinions 
Out of Network 
2.3.2, 2.3.18, Services: 
2.7.1(bb), 2.12.3, Adequate and 
17 | 2.12.4, 2.14.5 438.206(b)(4) Timely Coverage 
Out of Network 
Providers: Cost 
18 | 2.4, 2.20.1(d) 438.206(b)(5) Sharing 
2.3.14(a)2, 
2.14.1, 2.14.4(a- 
19 | f), 2.17.1, 3.5.3 438.206(c)(1)(i-vi) Timely Access 
2.2.6(a)1-3, Cultural 
20 | 2.17.1 438.206(c)(2) Considerations 
Primary Care and 
Coordination of 
Healthcare 
21 | 2.14.11, 2.3.5(e) | 438.208(b) Services 
2.6.2(m), Care Coordination: 
22 | 2.14.11, 2.5.3(e) | 438.208(c)(1) Identification 
=. Performance Management Solutions Group 746 
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2.12.10, 
2.14.2(c), 
2.14.11, 2.17.5, 
Attachment 3 - 
Children with 
Special 
Healthcare Care Coordination: 
23 | Needs 438.208(c)(2) Assessment 
llodls Zod Care Coordination: 
24 | 2.14.11 438.208(c)(3) Treatment Plans 
2.3.8, 2.3.7, 
2.6.1(k)(3), Access to 
25 | 2.14.6, 2.14.7 438.208(c)(4) Specialists 
2.2.1(i), 2.3.7, 
2.7.4, 2.9.2, 
2.10.2, 2.14.1, 
2.14.2(a-h), Authorization of 
26 | 2.14.2(d)1-2 438.210(b) Services 
2.15.4, Notice of Adverse 
27 | 2.14.2(d)6 438.210(c) Action 
2.6.2(k)(3), 
2.14.2(d)6, 
2.15.4(a-c), Timeframe for 
28 | 2.16.3(e) 438.210(d) Decisions 
Compensation for 
Utilization 
Management 
29 | 2.17.5(b) 438.210(e) Decisions 
Emergency and 
2.4.8, 2.7.1, Pos-stabilization 
2.7.1(y), 2.7.3(v), pgs 24/25 Rev. 
30 | 2.14.2 438.114 Checklist 
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Compliance Review Scoring Form 





Subpart D: Quality Assessment and Performance Improvement: Structure and Operation Standards 





General Rules for 









































2.17.2(n), Credentialing and 
31 | 2.17.5(c), 2.30.2 | 438.214(a,b) Recredentialing 
Nondiscrimination 
and Provider 
438.214(c) and Discrimination 
32 | 2.2.6(b)(c) 438.12 Prohibited 
Excluded 
33 | 2.31.5 438.214(d) Providers 
Other State 
Requirements: 

34 | 2.3.9, 2.3.17 438.214(e) Provider Selection 
2.6.2(n)(2), Disenrollment: 
2.6.2(s)(all), 438.226 and Requirements and 

35 | 2.6.2(u) 438.56(b)(1-3) Limitations 
2 Dole 2 502 Disenrollment 
2.5.6, 2.6.1(g), Requested by 

36 | 2.6.2® 438.56(c) Enrollee 

Procedures for 
Disenrollment -- 
Pgs 29/30 Rev. 
37 | 2.6.2(r,S-1,t) 438.56(d) Checklist 
Timeframe for 
Disenrollment 
38 | 2.6.2(u) 438.56(e) Determinations 
Grievance 

39 | 2.15, 2.15.3(a,b) | 438.228 Systems 
2.6.1(a)(18), 
2.16.2(c), 
2.31.2(a)8, Subcontractual 
2.31.3, 3.5.1, Relationships and 

40 | 3.5.2, 3.5.3 438 .230(a,b) Delegation 
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Subpart D: Quality Assessment and Performance Improvement: Measurement and Improvement 





41 


2.17.2(d) 


438.236(b)(1-4) 


Adoption of 
Practice 
Guidelines 


There is very little in the 
contract compliance tool 
regarding practice 
guidelines. 





42 


2.17.2(d) 


438.236(c) 


Dissemination of 
Practice 
Guidelines 





43 


2.17.2(d,f) 


438.236(d) 


Application of 
Practice 
Guidelines -- Pgs 
32/33 of Rev. 
Checklist 





44 


Cedltfcdl, Zolh (5) 


438.240(a)(1) 


Quality 
Assessment and 
Improvement 
Program 





45 


2.17.5(d) 


438.240(b)(1) and 
438.240(d) 


Basic Elements of 
MCO QI and PIPs 





46 


Doll, Cotl/S, 
Attachment 6 


438.240(b)(2)(c) 
and 438.204(c) 


Performance 
Measurement 





47 


2.17.5(b) 


438.240(b)(3) 


Basic elements of 


MCO QI and PIPs: 


Monitoring 
Utilization 





48 


2.17.5 


438.240(b)(4) 


Basic elements of 
MCO QI and PIPs 





49 


Attachment 6 - 
State Quality 
Strategy 


438.240(e) 


Program Review 
by State 








50 





2.25 





438.242(a) 





Health Information 
Systems 
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2.25(all) - 2.25.1, 


Compliance Review Scoring Form 


















































2.25.2(a,b), Basic Elements of 
51 | 2.25.3, 2.25.4 438 .242(b)(1,2) HIS 
Basic Elements of 
52 | 2.26.1, 2.29.1 438 .242(b)(3) HIS 
Total Quality Improvement and 
Assessment 
Subpart F: Grievance Systems 
Grievance and 
Appeals: General 
Bs) || Zulli 438.402(a) Requirements 
Grievance and 
2.15.2, 2.15.5(a), Appeals: Filing 
54 | 2.15.6(a) 438 .402(b)(1) Authority 
Grievance and 
55 | 2.15.6(a) 438.402 (b)(2) Appeals: Timing 
2.15.2(a), Grievance and 
2.15.5(a), Appeals: 
56 | 2.15.6(a,b) 438.402(b)(3) Procedures 
Notice of Action: 
2.15.2(e), Language and 
57 | 2.15.4(a),2.6.2(q) | 438.404(a) Format 
Notice of Action: 
58 | 2.15.4(b) 438.404(b) Content 
Notice of Action: 
59 | 2.15.4(c) 438.404(c) Timing 
Handling of 
Grievances and 
2.15.5(b,c,d), Appeals: General 
60 | 2.15.6(h,i,j) 438.406(a) Requirements 
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61 


2.15.6(g) 
2.15.6(h) 
2.15.6(i) 2.15.6()) 


438.406(b) 


Handling of 
Grievances and 
Appeals: Special 
Requirements 


Compliance Review Scoring Form 





62 


2.15.5(e), 
2.15.6(k) 


438.408(a) 


Resolution and 
notification: 
Grievances and 
Appeals - Basic 
rule 





63 


2.15.5(e,f), 
2.15.6(k-l) 


438.408(b,c) 


Resolution and 
notification: 
Grievances and 
Appeals - 
Timeframes and 
extensions 





64 


2.15.5(e), 
2.15.6(k,m) 


438.408(d)(e) 


Resolution and 
notification: 
Grievances and 
Appeals - Format 
and content 





65 


2.15.2(i), 
2.15.6(m) 


438.408(f) 


Resolution and 
notification: 
Grievances and 
Appeals - 
Requirements for 
State fair hearing 





66 


2.15.6(n,0) 


438.410 


Expedited 
resolution of 
appeals 





67 


2.15.2(c), 
3.5.3(c) 


438.414 


Information about 
the grievance 
systems of 
providers and 
subcontractors 





68 








2.15.3 


438.416 








Recordkeeping 
and reporting 
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This protocol was developed using the CMS MCO Compliance protocol worksheet and cross-matching the State of Missouri Eastern/Central 
Region contract and the State supplied Compliance Tool for 2004. 
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Appendix 13 - Compliance Interview Tools 


CASE MANAGEMENT STAFF 


Behavioral Health Concepts, Inc. 
Victoria Park, 2716 Forum Blvd., Suite 4, Columbia, MO 65203 (573) 446-0405 
la (573) 446-1816 (fax) 


(866) 463-6242 (toll-free) 
www.bhcinfo.com 
Care/Case Manager Interview Protocol 
2007 EQRO 


Member Rights and Protections 


1. How do you receive referrals for case/care management services? 
2. When you receive a new referral what do you do? 


3. Describe what you do when you are case managing a member? Are contacts and 
service information recorded in an information system? Who participates in the 
decision-making process? 


4. How does the healthplan ensure that members participate in care and treatment 
decisions? 


5. Are members informed of their right to accept or refuse treatment and to execute an 
advance directive? Are you aware of the healthplan’s policies on implementation of 
this right? 


6. Describe any training or information you have received about the Federal/State laws 
regarding member rights that must be observed in day-to-day operations? How did 
this occur? 


Quality Assessment and Performance Improvement 
Access Standards 


1. How are members with special health care needs identified and tracked within your 
system? 
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10. 


11. 


12. 


What mechanisms does the healthplan employ to assess member’s service needs? 
How are assessment activities conducted? 


Describe a time when you assisted a member in obtaining special services, such as 
home health care. If this has never occurred, has this type of service been 
requested? If it is never authorized, what is the healthplan policy about approving 
special services? What circumstances would have to exist for these services to be 
authorized? 


How do you assist in developing a written treatment plans when a member has an 
Ongoing special condition that requires a course of treatment or regular care 
monitoring? How is it decided which members receive a written treatment plan? 


How are written treatment plans developed? How do you ensure that the care plan 
addresses the needs identified in the assessment? 


Describe the treatment planning process, and the process used to determine the 
appropriate use of specialists? 


How many treatment plans are developed annually? Were any requests for 
treatment planning denied? Why? 
Describe the processes used to coordinate services for members? Are they different 


for different types of member needs? 


Who is responsible for coordinating the care of members with special health care 
needs? 


How do you coordinate medical services and mental health/substance abuse 
services? Do you exchange information between providers? 


Are you aware of the proportion of members having an ongoing source of primary 
care? 


How many members have someone designated as preliminarily responsible for 
coordination their health care services? (percentage?) How many of these are 
members with special health care needs? 
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Measurement and Improvement Standards 


1. 


Have you or other case management staff ever received a request from a member 
for practice guidelines? How was this handled? 


Grievance Systems 


1. Tell us how you handle a situation when an authorization decision is adverse to a 
member? 

2. If amember indicates they wish to file a grievance, what do you do? 

3. If amember remains dissatisfied and indicates that they want to file an appeal what 
do you do? Are members required to exhaust the internal appeal process before 
seeking and receiving a State fair hearing? 

4. Who assists members in negotiating the healthplan’s grievance and appeals system, 
including completing forms or taking other steps to resolve an appeal or grievance? 
Do you ever assist a member? If they indicate a need for assistance, who helps 
them? 

5. What happens if a member makes an oral request to appeal an action? 

6. How often are grievances and appeals analyzed for trends? Do you receive reports 
of this type of analysis? What action is taken? 

7. Are you ever involved in the analysis of grievances and appeals and how this reflects 
on the healthplans service delivery system? Does the healthplan have a Quality 
Assessment and Performance Improvement Program? 

8. Can members continue to receive benefits during the grievance/appeal process? If 
they do and the grievance/appeal is upheld what happens? 
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MEMBER SERVICES STAFF 


Behavioral Health Concepts, Inc. 
Victoria Park, 2716 Forum Blvd., Suite 4, Columbia, MO 65203 (573) 446-0405 
A (573) 446-1816 (fax) 


(866) 463-6242 (toll-free) 
www.bhcinfo.com 
Member Services Staff Interview Protocol 
EQR 2007 


Enrollee Rights and Responsibilities 


Goal: To confirm that the health plan is effectively implementing policies and procedures 
to communicate with members about the rights, their rights to information, and to 
supplement information obtained in document review. 


Member Services Staff 


1. Give us an example of the type of information provided to an individual if they call 
asking a question about the healthplan. What information is routinely provided to 
members? How is this information disseminated to new members? Is there a 
different script for existing members? What format is used? 


2. Tell us about a situation where you realized that you needed to communicate with a 
caller in a different language or in an alternative format. How is the need for an 
alternative language or format determined? What procedures exist for handling 
communications with non-English speaking members? 


3. Describe how you inform members of available providers? What would you do ifa 
member asked for a provider who speaks another language, or has specific cultural 
characteristics? 


4. How do you inform members of termination of a contracted provider? What has 
occurred when a PCP is terminated? Are you award of this type of situation within 
the past year? 


5. Describe what you would do if a member called and complained that they were 
treated badly and their privacy was compromised by discussion of their situation in a 
public setting at a provider's office. 


Ga Performance Management Solutions Group 756 
oe A division of Behavioral Health Concepts, Inc. 


MO HealthNet Managed Care Extemal Quality Review Appendix 13 


Report of Findings - 2007 Compliance Interview Tools 


6. How does the healthplan monitor member rights to service availability, coordination 
and continuity of care, coverage and authorization of service, and to obtain a second 
opinion? What are the most recent results of any monitoring that has occurred? 


7. What would you if a member called asking to obtain access to their medical records, 
or other information obtained by the healthplan or their providers? (Are members 
informed of their right to request and receive a copy of their medical records, and 
their right to request that these records be amended or corrected?) 


8. I’m amembers and | call with a concern. Describe what happens or how this might 
be handled. 


9. Describe any training or information you have received about the Federal/State laws 
regarding member rights that must be observed in day-to-day operations? How did 
this occur? 


10. Have you received any complaints from members involving a perceived violation of 
the rights? How was this resolved? 


11. Is any information been collected to determine that care and services are provided in 
a timely manner? If the MCO learns that this is not occurring, what action occurs? 


Quality Assessment and Performance Improvement 
Access Standards 


13. What occurs if a member calls and states that they can not receive services when 
they are needed (after normal business hours or on Saturdays)? 


14. Describe a situation when a member complains that they can not get a service they 
believe they need. (What types of service require prior authorization? What occurs 
if you determine that a member needs a service requiring a prior authorization?) 


15. How frequently does member services staff receive complaints about provider hours, 
or not being able to get timely services or appointments? If you receive and pass on 
a complaint about the unavailability of a provider, are you informed about any 
corrective action taken? 


16. Tell us about a time when a member called and appears to have special health care 
needs? What did you do? 
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17. How frequently do you receive complaints about difficulty obtaining emergency or 
post-stabilization services? Describe the procedure for handling member calls 
regarding need for emergency services. 


18. Does the MCO conduct surveys, focus groups, or other activities to receive feedback 
from members? Are you aware of any findings? 


Structure and Operation Standards 


19. What do you do if a member requests disenrollment. Is this information or action 
tracked? Does this occur often? 


20. Describe the process for informing members of any decision to deny, limit, or 
discontinue a request for service. What are the time frames for notification? 


Measurement and Improvement Standards 


21. Have you or other member service staff ever received a request, from a member, for 
practice guidelines? How was this handled? 


Grievance Systems 


22. If a member contacts you and says they want to file a grievance, how do you handle 
this? Are there materials that contain information about the grievance and appeal 
process? When do members receive this information? 


23. What happens if you determine that an issue presented is a grievance. Describe 
your actions if you think this is a complaint that does not rise to the level of a member 
grievance. What type of issues do members call to complain about or file a 
grievance? (Has the MCO received complaints from members who had difficulty 
obtaining timely access to the records? How was this resolved?) 


24. Are you aware of the MCO’s grievance resolution process? How do you understand 
this process? The appeals process? 


25. How is it determined that an enrollee’s appeal requires expedited resolution? 
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26. How is the member informed on a denial of a request for an expedited resolution? 
27. How many issues become a State Fair Hearing? 


28. Who assists members in using the organization’s grievance and appeals system, 
including completing forms or taking other steps to resolve an appeal or grievance? 
If a member indicates a need for assistance, who helps them? 


29. What happens is a member makes a verbal request to appeal an action? 


30. Are you ever involved in the analysis of grievances and appeals and how this reflects 
on the healthplan’s service deliver system? Does the healthplan have a Quality 
Assessment and Performance Improvement Program? Are you involved? How? 


31. Can members continue to receive benefits during the grievance/appeal process? If 
they do and the grievance/appeal is upheld 
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Appendix 14 - Site Visit Information Request Letter 


June XX, 2008 
<Plan Administrator> 
<Plan Name> 
<Address> 
RE: SITE VISIT AGENDA AND DOCUMENT REVIEW 


Dear 





We are finalizing plans for the on-site reviews of each MCO. The following information 
is being provided in an effort to make preparations for the on-site review as efficient as 
possible for you and your staff. The following information or persons will be needed at 
the time of the on-site review at <Health Plan Name> on July XX, 2008. 


Performance Improvement Projects 


Time is scheduled in the afternoon to conduct follow-up questions, review databases, and 
provide verbal feedback to the MCO regarding the planning, implementation, and 
credibility of findings from the Performance Improvement Projects (PIPs). Any staff 
responsible for planning, conducting, and interpreting the finings of PIPs should be 
present during this time. The review will be limited to the projects and findings 
submitted at the end of 2007. Please be prepared to review databases and any data 
collection forms not originally submitted. 


Performance Measure Validation 


As you know, BHC is in the process of validating the following three performance 
measures: 


= HEDIS 2007 Follow-Up After Hospitalization for Mental Illness 
= HEDIS 2007 Annual Dental Visit 
= HEDIS 2007 Adolescent Well Care 


BHC is following the CMS protocol for validating performance measures. The goals for 
this process are to: 


= Evaluate the accuracy of Medicaid performance measure reported by the MCO; and 

= Determine the extent to which Medicaid-specific performance measures calculated by 
the MCO followed specifications established by the Division of Medical Services. 
These specifications consist of the HEDIS 2007 Technical Specifications. 
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To complete this process we will review the following documents while on-site: 


Data Integration and Processes Used to Calculate and Report Performance 
Measures 


Documentation of the performance measure generating process 

Documentation of computer queries, programming logic, or source code (if available) 
used to create denominators, numerators and interim data files - for each of the three 
measures 

Code mapping documentation 

Documentation of results of statistical tests and any corrections with justification for 
such changes, if applicable - for each of the three measures 

Documentation showing confidence intervals of calculations when sampling 
methodology used — for each of the three measures 

Description of the software specifications or programming languages instructions 
used to query each database to identify the denominator, and/or software manual 
Source code for identifying the eligible population and continuous enrollment 
calculation — for each of the three measures 

Description of the software specification or programming languages used to identify 
the numerator 

Programming logic and/or source code for arithmetic calculation of each measure to 
ensure adequate matching and linkage among different types of data 


Sampling Validation 


Description of software used to execute sampling sort of population files 

Source code for how samples for hybrid measures were calculated 

Policies to maintain files from which the samples are drawn in order to keep 
population intact in the event that a sample must be re-drawn or replacements made 
Documentation that the computer source code or logic matches the specifications set 
forth for each performance measure, including sample size and exclusion 
methodology 

Documentation of “frozen” or archived files from which the samples were drawn 
Documentation assuring that sampling methodology treats all measures 
independently, and there is no correlation between drawn samples 


Performance Measure Interviews 


In addition to the documentation reviews, interviews will be conducted with the person(s) 


responsible for: 

Overseeing the process of identifying eligible members from MCO data sources for 
the measures to be validated; 

Programming the extraction of required elements from the MCO data sources for the 
measures to be validated; 

Integrity checks and processes of verifying the accuracy of data elements for the 
measures to be validated; 
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=™ Overseeing the process of medical record abstraction, training, and data collection for 
the measures to be validated; and 
™ Contractor oversight and management of any of the above activities. 


On-site activities may also include, but are not limited to, the following: 


= Demonstration of HEDIS software 
= Demonstration of the process for extracting data from MCO databases 
® Possible data runs for identifying numerator and denominator cases 


Compliance Review 


The final activity to prepare for during the on-site visit will be staff interviews with 
Member Services Staff, Case/Care Management Staff, and Healthplan Administrators. 
Documentation reviews and interviews with MO HealthNet staff have occurred prior to 
the on-site visit. This enables BHC to use the time at the MCO as efficiently as possible. 
Some documentation will be reviewed at the Healthplan Offices prior to the on-site 
review date. The following information will be needed during this pre-review on-site 
time: 


Compliance Documents 


= Member Handbook 
= 2007 Marketing Plan and materials 
= Grievance logs (members and providers) 


Compliance Interviews 


The attached agenda requests an interview in the morning with the Member Services and 
Case/Care management staff. A group of four (4) to six (6) representatives from each 
work group will be appreciated. 


We will also interview Healthplan Administrative staff. It will be helpful to include the 
following: 


=" Plan Director 

=" Medical Director 

* Quality Assurance Director 

= Provider Services/Provider Relations Director 
= Member Services Director 

= Utilization Management Director 

= Case Management Director 
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Concurrent activities and interviews are scheduled in the morning. If separate conference 
rooms or meeting space can be arranged, this will make the process much easier to 
coordinate. Also, the on-site review team will need to order a working lunch on the day 
of the visit. If lunch facilities are not available, please provide the name and telephone 
number of a service in your vicinity that can accommodate ordering lunch. Your 
assistance will be appreciated. 


The Healthplan staff involved in any of the referenced interviews or activities, or anyone 
identified by the Healthplan, is welcome to attend the introduction and/or the exit 
interview. 

Again, your assistance in organizing the documents, individuals to be interviewed, and 
the day’s activities is appreciated. If you have questions, or need additional information, 
please let me know. 


Sincerely, 


Mona Prater 
Assistant Project Director 


Ce: Amy McCurry Schwartz, Esq., Project Director 
Susan Eggen, Division of Medical Services 


Attachment: 
On-Site Review Agenda 
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